Extract Incremental Data from DB which does not KeyColumn or LastupdatedTimestamp fields (Type : Insert ,Update and Soft Delete)

vidyas16 — Sat, 16 Nov 2024 01:05:34 GMT

Dear All,

I am practicing incremental loads in QS. I have come across a table which updates the Enddate (NewStartDate-1)and Status field to NULL whenever there occurs an update, to particular record. It inserts a new record and old record is updated as mentioned above. There are No any lastupdated or createtimestamps fields to identify the updated records.

Could someone please help in how we can extract the latest modified records from the db when there is no any date field. As you can see we cannot use the ID column Employee_Key as this will not bring the soft deleted records.

The Sample data is from AdventureWorks DB provided by Microsoft SQL Server. I am not sure if tables with out create and update timestamp are valid for these kind of scenarios.

Thank you

Vidya S

topic Extract Incremental Data from DB which does not KeyColumn or LastupdatedTimestamp fields (Type : Insert ,Update and Soft Delete) in App Development

Extract Incremental Data from DB which does not KeyColumn or LastupdatedTimestamp fields (Type : Insert ,Update and Soft Delete)