PySpark Series Part I by Aida Martinez
Apache Spark is currently one of the most popular systems for large-scale data processing, making it a standard tool for any developer or data scientist interested in big data. Spark supports multiple widely used programming languages(Scala, Python, R, Java) and a wealth of built-in and third-party libraries.
In this session you will be introduced to the Apache Spark main concepts and you will learn how to leverage the DataFrame API to do data extractions. Furthermore, you will learn how to connect to different sources, apply schemas when reading data and handling corrupt records.
Repo access https://github.com/WomenWhoCode/WWCod...