07 Spark Streaming Read from Files | Flatten JSON data

Опубликовано: 11 Май 2026
на канале: Ease With Data

14,912

214

Video covers - How to read data from file in Spark Streaming ? What are different cleanSource Mode ? How to flatten JSON data?

Chapters:
00:00 - Introduction
00:25 - Device Data Example
01:27 - Batch code to Flatten data
06:35 - Streaming Code to Flatten Data
07:28 - cleanSource option
08:20 - maxFilePerTrigger Option
11:32 - Checkpoint Directory

URLs:
Github Code - https://github.com/subhamkharwal/spar...
Dataset: https://github.com/subhamkharwal/spar...

Keywords: Apache Spark, PySpark, Spark Streaming, Real-time Data Processing, Data Streaming, Big Data Analytics, PySpark Tutorial, Apache Spark Tutorial, Streaming Analytics, Spark Structured Streaming, PySpark Streaming, Big Data Processing.

New video in every 3 days ❤️

Make sure to like and Subscribe.