How to use DataFrames and SparkSQL in Spark Tutorial
In this video I show you how to process data with spark. We use Dataframes and SparkSQL to modify and display data. We also read and write files from local storage as parquet files.
This was really fun and a quick tutorial how to work with Spark through Zeppelin notebooks.
check out the full episode 103 of the podcast for the full hour.
►Learn Data Engineering with my Data Engineering Academy:
https://learndataengineering.com
Check out my free 100+ pages data engineering cookbook on GitHub:
https://github.com/andkret/Cookbook
Please SUPPORT WHAT YOU LIKE:
- As an Amazon Associate I earn from qualifying purchases from Amazon. Just use this link:
https://www.amazon.com/shop/plumberso...
#plumbersofdatascience #ApacheSpark #DataEngineering