Capture Changed Data in Azure Data Factory - Handling deletions in Incremental Loads - 3 simple ways
In this video, we see 3 different but simple ways to perform incremental loading on Azure Data Factory. We also see how to handle deletes in incremental loads as it is a very common scenario. Copy Activities and Mapping Data Flows on Azure Data Factory are used for the implementation of these examples. You will find the SQL Code on my GitHub account.
Follow me on social media:
LinkedIn: / apostolos-athanasiou-9a0baa119
GitHub: https://github.com/apostolos1927/Incr...
00:00 - Intro
01:00 - Setting up the tables & inserting data
01:54 - Upsert using Dataflows
08:15 - Handling Deletions using Dataflows
13:30 - Testing Method 1
16:04 - Method 2 with Copy Activity and DataFlows
25:40 - Method 3 with Copy Activities and Stored Procedures
26:09 - Conclusion