data load tool (dlt) build database data pipeline | verified source | data pipeline | etl | Python

Опубликовано: 01 Октябрь 2024
на канале: BI Insights Inc
1,640
49

In this video we cover data load tool (dlt) verified source module. Verified Source is a Python module that allows creating pipelines that extract data from a particular Source.We add sql database sources to our dlt project. This helps us write clean data pipleines using dlt's built-in modules. dlt is a Python based ETL (ELT) tool. If you need to catch up on dlt then here is the link to the initial video:    • how to build data pipelines with data...  

Links to related material.

Link to GitHub repo: https://github.com/hnawaz007/pythonda...

dlt docs: https://dlthub.com/docs/intro
verified source: https://dlthub.com/docs/general-usage...

Postgres installation video:    • How to install PostgreSQL  on windows...  
SQL Server Installation vidoe:    • Install SQL Server Express 2019 Step ...  

dbt series: https://hnawaz007.github.io/mds.html

Link to related aritcle on medium:   / data-load-tool-dlt-a-python-library-for-ex...  


Link to Channel's site:
https://hnawaz007.github.io/
--------------------------------------------------------------

💥Subscribe to our channel:
   / haqnawaz  

📌 Links
-----------------------------------------
#️⃣ Follow me on social media! #️⃣

🔗 GitHub: https://github.com/hnawaz007
📸 Instagram:   / bi_insights_inc  
📝 LinkedIn:   / haq-nawaz  
🔗   / hnawaz100  
🚀 https://hnawaz007.github.io/

-----------------------------------------

#ETL #python #dlt

Topics in this video (click to jump around):
==================================
0:00 - Introduction to data load tool (dlt) verified source
1:03 - List & Add Verified Source
1:52 - Review SQL Database Source Module(s)
2:44 - Add SQL Server Secrets
2:23 - Configure Secrets
3:08 - SQL Database Pipeline overview
3:58 - Updated SQL Database Pipeline
5:14 - Run the dlt pipeline
6:03 - Review pipelines results
7:08 - Coming Soon