topic If we dont have Modification date in the source, canot we implement Incremental load?. in QlikView

If we dont have Modification date in the source, canot we implement Incremental load?.

Thu, 20 Dec 2012 08:26:09 GMT

If we dont have Modification date in the source, canot we implement Incremental load?. how?

Re: If we dont have Modification date in the source, canot we implement Incremental load?.

abhijain — Thu, 20 Dec 2012 08:41:36 GMT

Without having modification date in your source u can implement incremental load:

If u have primary key in your table then please use the where clause as Where not Exist(Primary Key)

Re: If we dont have Modification date in the source, canot we implement Incremental load?.

jagan — Thu, 20 Dec 2012 08:43:29 GMT

Hi,

That depends on your data, is your records get updated? If no, then you can do this based on the primary key you can load the new records, if your data modifies then it is not possible, because you do not have a track which record got updated.

Hope this helps you.

Regards,

Jagan.

Re: If we dont have Modification date in the source, canot we implement Incremental load?.

flipside — Thu, 20 Dec 2012 09:06:54 GMT

You could check every field in the row, the easiest way is to create a composite field, but this isn't very efficient if you have lots of data, or long text fields ...

Original data:

Field1: Field2: Field3: Field4:

101 Apples Red 0.50

New Data:

Field1: Field2: Field3: Field4:

101 Apples Green 0.50

When loading, create a key such as Field1 & '-' & Field2 & '-' & Field3 & '-' & Field4 as CompositeField, then you can compare the CompositeFields for each key when you load new data, and if they don't match you know it's been amended.

flipside