Read & Query Delta Lake Tables with PySpark | Delta Lake Tutorial Part 2
#pyspark #bigdata #deltalake
Delta Lake Tutorial with PySpark — Read and Query Delta Tables
In this second video of the Delta Lake tutorial series, I show you how to read a Delta table using PySpark and perform basic transformations and SQL queries on it. This tutorial is based on the Jupyter Notebook 2_read_delta_table.ipynb.
⸻
🔍 What You’ll Learn:
1. 🔧 Initialize a PySpark Session with Delta Support
2. 📥 Read Delta Tables Using DataFrame API
3. 🧾 Filter, Select, and Aggregate Data
4. 🗃️ Register and Query Delta Table with SQL
5. ⚡ Understand How Delta Lake Blends Data Lake and Warehouse Strengths
⸻
🎯 Ideal For:
• Data Engineers and Analysts working with Delta Lake
• Beginners learning PySpark
• Anyone exploring the Lakehouse architecture
⸻
📁 Tools Used:
• PySpark
• Delta Lake
• Jupyter Notebook
Timestamps:
00:00 Intro
00:49 Read the delta table
01:09 Print Schema
01:19 Using SQL to explore Delta Tables
01:47 Get the history of Delta Tables