topic Re: incremental load-help in QlikView

incremental load-help

Wed, 25 Jun 2014 11:01:22 GMT

Hey Guys...

I am doing incremental load and in this i have loaded new data but i just want to know what if i made changes in old data will it will be reflected in the qvd by incremental load

Please rply..

Thanks

Re: incremental load-help

sasikanth — Wed, 25 Jun 2014 11:05:45 GMT

HI akash

Yes you can do it by doing inner join with the old data with your current data

Attachment will explain you different possible scenarios of incremental load

Hope it will help you

Re: incremental load-help

its_anandrjs — Wed, 25 Jun 2014 11:05:58 GMT

Yes but you have to load that updated row which is old data but right now it is updated then load that rows also and replace the row in the QVD because in QVD that is not updated so you need to update that row in QVD. You need Insert,Update, Delete incremental load.

Re: incremental load-help

Wed, 25 Jun 2014 11:11:25 GMT

HI,

Insert-:

We need “Modification Date” field. So that we will read the records modification time is greater than or equal to last execution time.

After we concatenate in to the existing Qvd and store it to Qvd

Example:

SQL SELECT PrimaryKey, X, Y FROM DB_TABLE

WHERE ModificationTime >= #$(LastExecTime)#;

Concatenate

LOAD PrimaryKey, X, Y FROM File.QVD;

STORE QV_Table INTO File.QVD;

Insert and Update

Same concept for insert only change here we need to implement NOT Exists(PrimaryKey) so that we can able to get the updated records.

Example:

SQL SELECT PrimaryKey, X, Y FROM DB_TABLE

WHERE ModificationTime >= #$(LastExecTime)#;

Concatenate

LOAD PrimaryKey, X, Y FROM File.QVD

WHERE NOT Exists(PrimaryKey);

STORE QV_Table INTO File.QVD;

Insert,Update and Delete

Same concept for insert and update, here tricky is need to use inner join for eliminating deleted records.

Example:

SQL SELECT PrimaryKey, X, Y FROM DB_TABLE

WHERE ModificationTime >= #$(LastExecTime)#;

Concatenate

LOAD PrimaryKey, X, Y FROM File.QVD

WHERE NOT EXISTS(PrimaryKey);

Inner Join

SQL SELECT PrimaryKey FROM DB_TABLE;

STORE QV_Table INTO File.QVD;

Re: incremental load-help

SunilChauhan — Wed, 25 Jun 2014 11:13:04 GMT

see the attched

hope this helps

Re: incremental load-help

Anonymous — Wed, 25 Jun 2014 11:25:20 GMT

Hello Akash!

See this PPT file.

He helped me a lot.

Hugs