sql server – Load SQL Onpremises data incrementally to Azure Blob Storage through Azure data factory

You can do this using copy activity from data factory.

Since there are multiple tables you want to load up, you need to build a for loop. Each table you need to loop is one iteration in this for loop:

Inside the copy activity, there’s one more challenge to handle. You can’t load the full tables content each iteration.
To load only the latest data, that haven’t been loaded earlier, you need to implement some delta-load-mechanism.
These delta-load-mechanism are called CDC (change data capture) and act like a watermark. For CDC, there are different variants available and i recommend you the query-based-cdc for this usecase. More info here: www.qlik.com/us/change-data-capture/cdc-change-data-capture

The query based CDC data consumption in data factory could look like this:

SELECT * from dbo.table1 WHERE TIMESTAMP > GETDATE() -1