Skip to main content
Announcements
July 15, NEW Customer Portal: Initial launch will improve how you submit Support Cases. IMPORTANT DETAILS
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

If we dont have Modification date in the source, canot we implement Incremental load?.

If we dont have Modification date in the source, canot we implement Incremental load?. how?

3 Replies
abhijain
Partner - Contributor III
Partner - Contributor III

Without having modification date in your source u can implement incremental load:

If u have primary key in your table then please use the where clause as Where not Exist(Primary Key)

jagan
Luminary Alumni
Luminary Alumni

Hi,

That depends on your data, is your records get updated?  If no, then you can do this based on the primary key you can load the new records, if your data modifies then it is not possible, because you do not have a track which record got updated. 

Hope this helps you.

Regards,

Jagan.

flipside
Partner - Specialist II
Partner - Specialist II

You could check every field in the row, the easiest way is to create a composite field, but this isn't very efficient if you have lots of data, or long text fields ...

Original data:

Field1:     Field2:     Field3:     Field4:

101          Apples     Red          0.50

New Data:

Field1:     Field2:     Field3:     Field4:

101          Apples     Green        0.50

When loading, create a key such as Field1 & '-' & Field2 & '-' & Field3 & '-' & Field4 as CompositeField, then you can compare the CompositeFields for each key when you load new data, and if they don't match you know it's been amended.

flipside