Apache Spark Session
Spark is an open-source, in-memory computation and data processing framework offered by Apache.
Core components of Spark are:
a. Storage: Spark does not have its own storage system like HDFS in Hadoop. It needs Hadoop HDFS for storing data on cluster computers.
b. Processing: Spark brings data to memory and can do near real-time data streaming. Parallel and in-memory data processing make Spark much faster than data processing in Hadoop.
In this lecture, you will learn about the Apache Spark session.
Get the complete course at
https://www.udemy.com/course/apache-s...
You might also like my article
https://towardsdatascience.com/spark-...