In this video, we see how to use the Look-up, the ForEach and the IF activities in Azure Data Factory. We parameterize datasets and utilizing the above activities we dynamically perform bulk copy from one Blob Storage Container to another or from Blob Storage to Azure Database.
Stay tuned for more Data Engineering videos!
Follow me on social media:
LinkedIn: / apostolos-athanasiou-9a0baa119
GitHub: https://github.com/apostolos1927
00:00 - Intro
00:47 - LookUp, ForEach, IF statement
03:57 - Existing resources & data for the demo
05:28 - Creating Datasets
11:09 - Creating Pipeline with Nested IF statement
20:22 - Running & Debugging the Pipeline
22:38 - Testing results