Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
If we dont have Modification date in the source, canot we implement Incremental load?. how?
Without having modification date in your source u can implement incremental load:
If u have primary key in your table then please use the where clause as Where not Exist(Primary Key)
Hi,
That depends on your data, is your records get updated? If no, then you can do this based on the primary key you can load the new records, if your data modifies then it is not possible, because you do not have a track which record got updated.
Hope this helps you.
Regards,
Jagan.
You could check every field in the row, the easiest way is to create a composite field, but this isn't very efficient if you have lots of data, or long text fields ...
Original data:
Field1: Field2: Field3: Field4:
101 Apples Red 0.50
New Data:
Field1: Field2: Field3: Field4:
101 Apples Green 0.50
When loading, create a key such as Field1 & '-' & Field2 & '-' & Field3 & '-' & Field4 as CompositeField, then you can compare the CompositeFields for each key when you load new data, and if they don't match you know it's been amended.
flipside