Orchestrate Airbyte & dbt with Dagster | Orchestrate Modern Data Stack with Dagster | Airbyte | dbt
In this video we will cover orchestration for the recently concluded dbt project project. We will orchestrate the entire project; Extract and Load part carried out with Airbyte and Transformation via dbt. We will use Dagster as the orchestrator. With new updates Dagster makes it very easy to import a dbt & Airbyte project and expose each model via the DAG.
Link to GitHub repo: https://github.com/hnawaz007/dbt-dw
Link to Modern Data Stack playlist: • How to build data pipelines with Airbyte |...
#dbt #etl #dagster
💥Subscribe to our channel:
/ haqnawaz
📌 Links
-----------------------------------------
#️⃣ Follow me on social media! #️⃣
🔗 GitHub: https://github.com/hnawaz007
📸 Instagram: / bi_insights_inc
📝 LinkedIn: / haq-nawaz
🔗 / hnawaz100
-----------------------------------------
Topics covered in this video:
==================================
0:00 - Introduction to dbt orchestration
0:42 - Dagster as orchestrator
1:11 - Prerequisites
1:30 - Create dbt Dagster Project
2:31 - Overview of dbt Dagster Project
3:19 - Preview dbt Dagster Project
4:05 - Add Airbyte as dbt sources
8:26 - Preview Airbyte Asset
9:10 - Fix Lineage
11:43 - Preview of Completed Project
12:34 - Run and review of the project