What are the main libraries of Apache Spark?
Some of the main libraries of Apache Spark are as follows:
I. MLib: This is Spark’s Machine Learning library. We can use it to create scalable machine learning system. We can use various machine learning algorithms as well as features like pipelining etc with this library.
II. GraphX: This library is used for computation of Graphs. It helps in creating a Graph abstraction of data and then use various Graph operators like- SubGraph, joinVertices etc.
III. Structured Streaming: This library is used for handling streams in Spark. It is a fault tolerant system built on top of Spark SQL Engine to process streams.
IV. Spark SQL: This is another popular component that is used for processing SQL queries on Spark platform.
Join complete Spark Interview Questions Preparation Course now for $10 only!!
https://www.udemy.com/apache-spark-in...