topic Re: Find Modified records in Incremental load in QlikView

Find Modified records in Incremental load

paulwalker — Wed, 30 Dec 2015 06:23:35 GMT

Hi Community,

I have implemented Incremental load, it's working properly.

New records and Deleted records working perfect....

But, I have one base table, someone modified some records.

How to find modified records???

Thanks in Advance...

Re: Find Modified records in Incremental load

senpradip007 — Wed, 30 Dec 2015 06:29:17 GMT

Do you have any field containing timestamp in your table?

Re: Find Modified records in Incremental load

tresB — Wed, 30 Dec 2015 06:35:16 GMT

Basically you have to check if the updated timestamp in db is greater that the last execution time. The following script would help you deal Insert and Update case :

QV_Table:

SQL SELECT PrimaryKey, X, Y FROM DB_TABLE

WHERE ModificationTime >= #$(LastExecTime)#;

Concatenate LOAD PrimaryKey, X, Y FROM File.QVD

WHERE NOT Exists(PrimaryKey);

STORE QV_Table INTO File.QVD;

For better understanding, refer help/manual.

Re: Find Modified records in Incremental load

maxgro — Wed, 30 Dec 2015 07:04:21 GMT

How do you know someone modified some records?

Use the same logic in the Qlik script to check for modified records; usually there is in the source table a timestamp, date or counter to detect record changed: you store the last change in Qlik and, at the next reload, you check the timestamp, date or counter bigger than the stored one.