Azure Data Factory – Case Study 8 – Incremental Data Load from On Prem SQL to Azure Storage
Scenarios are endless when it comes to business requirements for data integration, migration, load, ingestion, extraction etc. etc. etc.
Azure Data Factory provides are bunch of tools to make things work. Some are easier than the others. Definitely the platform is evolving for good.
In this case the need was to create and maintain an Azure Data Storage with CSV files of data from an On premise SQL database. Need to capture incremental load.
For this particular case, I chose to use “Change Data Capture” feature available in On Premise SQL Servers and Azure SQL Servers as well. Let’s dive in.
Once again courtesy goes to Microsoft documentation and a real-life particular business scenario.
*** Send a request below if you would like to receive the slideshow in PDF format.
*** Send a request below if you would like to receive the slideshow in PDF format.