05 Understand Spark Session & Create your First DataFrame | Create SparkSession object | Spark UI
Video explains - How to create Spark Session? How to write DataFrame Queries ? What is Spark UI ? How to understand Actions in Spark ?
Chapters
00:00 - Introduction
00:33 - Local env setup
01:07 - Understand Use Case
01:20 - How to create SparkSession object ?
03:30 - What is Spark UI?
04:15 - Write our First DataFrame
06:10 - How Actions trigger job ?
09:30 - Spark Interactive Shell
10:21 - Bonus Tip
Local PySpark Jupyter Lab setup - • 03 Data Lakehouse | Data Warehousing ...
Python Basics - https://www.learnpython.org/
Code URL -https://github.com/subhamkharwal/pysp...
The series provides a step-by-step guide to learning PySpark, a popular open-source distributed computing framework that is used for big data processing.
New video in every 3 days ❤️
#spark #pyspark #python #dataengineering