Streaming Aggregates in Spark : Tumbling vs Sliding Windows with Kafka
Streaming Aggregates in Spark - Tumbling vs Sliding Windows with Kafka
In this video, we break down the concept of streaming aggregates in Spark Structured Streaming and explain the difference between tumbling and sliding windows. Using Kafka as the data source, we demonstrate how to effectively process and aggregate real-time data.
📽️ Chapters to Explore
0:00 Introduction
0:20 Use Case for streaming aggregation
1:57 Tumbling Window
4:36 Silding Window
💻 Code is available in GitHub: https://github.com/anirvandecodes/Spa...
🌟 Stay Connected and Level Up Your Data Engineering Skills!
🔔 Subscribe Now: / @anirvandecodes
🤝 Let's Connect: / anirvandecodes
🎥 Explore Playlists Designed for You:
🚀 Spark Structured Streaming with Kafka: • Spark Structured Streaming with Kafka: The...
🛠️ DBT (Data Build Tool): • DBT Tutorial
🌐 Apache Spark for Everyone: • Apache Spark for everyone
📌 Love the content? Show your support! Like, share, and subscribe to keep learning and growing in data engineering. 🚀
Song: Dawn
License: Creative Commons (CC BY 3.0) https://creativecommons.org/licenses/...
https://open.spotify.com/artist/5ZVHX...
Music powered by BreakingCopyright: https://breakingcopyright.com