Video covers - What are Tumbling, Sliding and Session Windows in Spark Streaming? What are different Window Operations in Spark Streaming? How to handle Late Data in Spark Streaming?
Chapters:
00:00 - Introduction
00:40 - Tumbling or Fixed Window
02:42 - Sliding or Overlapping Window
04:23 - Late data scenario and Importance of Watermark
06:37 - Session Window
URLs:
Github Code - https://github.com/subhamkharwal/spar...
Device data samples - https://github.com/subhamkharwal/spar...
To setup Kafka with Spark in Local environment - • 03 Spark Streaming Local Environment Setup...
JSON data Flattening and reading from files - • 07 Spark Streaming Read from Files | Flatt...
Keywords: Apache Spark, PySpark, Spark Streaming, Real-time Data Processing, Data Streaming, Big Data Analytics, PySpark Tutorial, Apache Spark Tutorial, Streaming Analytics, Spark Structured Streaming, PySpark Streaming, Big Data Processing.
New video in every 3 days ❤️
Make sure to like and Subscribe.