Confluent KAFKA and Databricks - PySpark Batch Processing & Streaming using KAFKA - Simple Tutorial
In this video we integrate Confluent Kafka and Databricks.
Using PySpark we create a producer and a consumer displaying how to use Confluent Kafka.
The code can be found here: https://github.com/apostolos1927/Kafk...
Follow me on social media:
LinkedIn: www.linkedin.com/in/apostolos-athanasiou-9a0baa119
GitHub: https://github.com/apostolos1927/
00:00 - Intro
01:20 - Kafka Architecture
03:13 - Set Up Confluent Kafka
06:00 - PySpark Kafka Batch Processing
14:45 - PySpark Kafka Streaming
19:08 - Conclusion