incremental load-help

[#1]

Hey Guys...

I am doing incremental load and in this i have loaded new data but i just want to know what if i made changes in old data will it will be reflected in the qvd by incremental load

Please rply..

Thanks

[sasikanth]

HI akash

Yes you can do it by doing inner join with the old data with your current data

Attachment will explain you different possible scenarios of incremental load

Hope it will help you

[its_anandrjs]

Yes but you have to load that updated row which is old data but right now it is updated then load that rows also and replace the row in the QVD because in QVD that is not updated so you need to update that row in QVD. You need Insert,Update, Delete incremental load.

[#4]

HI,

Insert-:

We need “Modification Date” field. So that we will read the records modification time is greater than or equal to last execution time.

After we concatenate in to the existing Qvd and store it to Qvd

Example:

SQL SELECT PrimaryKey, X, Y FROM DB_TABLE

WHERE ModificationTime >= #$(LastExecTime)#;

Concatenate

LOAD PrimaryKey, X, Y FROM File.QVD;

STORE QV_Table INTO File.QVD;

Insert and Update

Same concept for insert only change here we need to implement NOT Exists(PrimaryKey) so that we can able to get the updated records.

Example:

SQL SELECT PrimaryKey, X, Y FROM DB_TABLE

WHERE ModificationTime >= #$(LastExecTime)#;

Concatenate

LOAD PrimaryKey, X, Y FROM File.QVD

WHERE NOT Exists(PrimaryKey);

STORE QV_Table INTO File.QVD;

Insert,Update and Delete

Same concept for insert and update, here tricky is need to use inner join for eliminating deleted records.

Example:

SQL SELECT PrimaryKey, X, Y FROM DB_TABLE

WHERE ModificationTime >= #$(LastExecTime)#;

Concatenate

LOAD PrimaryKey, X, Y FROM File.QVD

WHERE NOT EXISTS(PrimaryKey);

Inner Join

SQL SELECT PrimaryKey FROM DB_TABLE;

STORE QV_Table INTO File.QVD;

[SunilChauhan]

see the attched

hope this helps

[Anonymous]

Hello Akash!

See this PPT file.

He helped me a lot.

Hugs