Azure Data Factory - How to parameterize Data Pipelines - Beginner's Guide
In this video, we see how to parameterize data pipelines on Azure Data Factory. We implement some basic examples of how to parameterize datasets and/or pipelines by copying data from Azure Blob Storage to Azure SQL Database and vice versa. Stay tuned for more Data Engineering videos.
Follow me on social media:
LinkedIn: / apostolos-athanasiou-9a0baa119
GitHub: https://github.com/apostolos1927
00:00 - Intro
01:46 - Parameters, Variables, Expressions, Pipelines
04:15 - Resources & data
05:35 - Datasets
11:39 - Parameterized Pipeline
20:35 - Parameterized Backup
22:28 - Set Variables
29:38 - Wildcard option and Merge