Databricks: Build Reliable ETL Pipelines with Delta Live Tables and Confluent Kafka
In this video we see how to build reliable ETL pipelines with DLT framwork. We ingest and consume data from a kafka topic and then we build the bronze, the silver and the gold layer.
You can find the Databricks Notebooks here:
https://github.com/apostolos1927/DLT_...
Follow me on social media:
LinkedIn: www.linkedin.com/in/apostolos-athanasiou-9a0baa119
GitHub: https://github.com/apostolos1927/
00:00 - Intro
01:26 - ETL pipeline Demo