First Steps Using Delta Lake - Lakehouse with Delta Lake (Part 3)
You want to learn the first steps using Delta Lake for your next Gen Data Landscape! Let me show you how to set up Delta locally and doing your first steps writing and loading delta tables. Check it out! 😊
What we will learn:
How to install Delta Lake on Spark
How to Save and Load data with Delta
How to check Delta Details and History
~~~~~~~~~~~~~ Subscribe - Like - Comment - Challenge ~~~~~~~~~~~~~
You want to master Data Engineering with PySpark? Subscribe here: / @datanikkthegreek
Feel free to comment or challenge my explanations as always. Happy to learn also myself more by the community.
~~~~~~~~~~~~~~~~~~~~~~~ Resources ~~~~~~~~~~~~~~~~~~~~~~~
Link to Slides: https://github.com/datanikkthegreek/S...
Link to Code: https://github.com/datanikkthegreek/S...
Delta Homepage: https://delta.io/
Get Starting Delta Page: https://delta.io/learn/getting-started/
Delta versions overview: https://docs.delta.io/latest/releases...
~~~~~~~~~~~~~~~~~~~~~~~ Chapters ~~~~~~~~~~~~~~~~~~~~~~~
00:00 - Introduction
00:45 - Install Delta Lake
02:39 - Set-Up Spark Session
04:07 - Write and load Delta Tables
07:30 - Transform Parquet to Delta
08:13 - Read Delta as Parquet
08:58 - Delta Table Details
10:59 - Delta Table History
12:24 - Summary
#spark #pyspark #lakehouse #datalakehouse #deltalake #dataengineering #dataengineeringessentials