Load the Source Data into Azure - SQL Database + Data Lake (Python, pyodbc) | UrbanKart Part 4

Опубликовано: 27 Август 2026
на канале: Data Victims
37
like

Part 4 of the UrbanKart end-to-end Azure data engineering series. In this video we load the source systems: we push the nine OLTP tables into Azure SQL Database with a Python loader, and we upload the Tigers and Wings marketplace feeds into Azure Data
Lake Storage Gen2. By the end, every source the pipeline needs is sitting in Azure,
ready for ingestion.

What you will do in this part:
Load the nine OLTP CSV tables into Azure SQL Database with Python and pyodbc
Use a fast bulk insert so 1.9M rows load quickly
Handle the tricky types cleanly (DECIMAL, DATETIME) and the right column widths
Upload the Tigers and Wings marketplace feeds into ADLS Gen2, date partitioned
Connect securely using your stored connection details
Verify the row counts so you know the load actually worked

Built and explained for beginner to senior data engineers, concepts first, then the
clicks.

THE FULL SERIES
Part 1 - Project overview and architecture:    • End-to-End Azure Data Engineering Project ...  
Part 2 - Generate the synthetic source data:    • End-to-End Azure Data Engineering Project ...  
Part 3 - Provision the Azure foundation:    • Provision Azure Foundation: Resource Group...  

GET THE PROJECT (optional, the videos are 100% free)
Full Build Guide (the complete click-by-click guide document, cost estimations, all
code and all report files): 10 USD one time
Power BI Report Pack (the finished six-page report, semantic model and Gold data
as CSV): 5 USD one time
To grab either, email [email protected]

TOOLS IN THIS PART
Python, pandas, pyodbc, Azure SQL Database, Azure Data Lake Storage Gen2.

HIRE ME / WORK WITH ME
Website: https://datavictims.io/
YouTube:    / @datavictims1  
LinkedIn:   / haseebullah-shaikh-a91a40179  
Upwork: https://www.upwork.com/freelancers/~0...
Fiverr: https://www.fiverr.com/s/YRpW6Rl

Project by Haseebullah Shaikh, Senior Data Engineer - Data Victims.
(c) 2026 Haseebullah Shaikh, Data Victims. All rights reserved.

#Azure #DataEngineering #AzureSQL #DataLake #Python #pyodbc #ADLS #ETL #PowerBI #DataPipeline