Build Your First Data Pipeline in Azure Data Factory
Learn the essential steps to create a robust data pipeline in Microsoft Fabric. This tutorial covers effective data processing and data management within the platform. Get started with your data engineering projects today using no code methods for data ingestion.
Our objective is to build a professional, Agentic AI-ready data pipeline in Microsoft Fabric that is self-aware, self-logging, and bulletproof against schema changes.
this is basic tutorial as appetizer for your Fabric journey ..!
Step-by-Step:
Create Data Factory:
Azure Portal → Create resource → Search "Data Factory"
Select V2, name it, create
Launch Data Factory Studio:
Open your Data Factory → Click "Launch Studio"
Create Connections (Linked Services):
Go to Manage → Linked Services
Create two connections:
SourceConnection (to Table1 database)
TargetConnection (to Table2 database)
Enter database credentials, test connections
Create Datasets:
Go to Author → + → Dataset
Create SourceTable1: Select SourceConnection, pick Table1
Create TargetTable2: Select TargetConnection, pick Table2
Build Pipeline:
Author → + → Pipeline
Name: CopyTable1ToTable2
Drag Copy Data activity from Activities panel
Configure Copy Activity:
Source tab: Select SourceTable1
Sink tab: Select TargetTable2
Choose Table action: "Truncate" (replace) or "Append" (add)
Mapping tab: Click "Import schemas" to auto-map columns
Save & Run:
Click Publish All
Go to Monitor to watch progress