Incremental Load Deletion of Records

[#1]

Hi All,

Can some one help me on Incremental Load while Loading Data through Excel Sheets. Total file and Deleted Records file seprately.

I am Success full till the Insert and Updated Records.

But stuck at the Deletion of Records.

The Key Point to Note here is I am getting Deletion Records File Separately.

When i am Writing and Inner Join its retaining only Deleted Records.

It would be great help if some one help me on this.

Regards,

Ravi

[crusader_]

Hi,

From Reference Manual:

QV_Table:

SQL SELECT PrimaryKey, X, Y

FROM DB_TABLE

WHERE ModificationTime >= #$(LastExecTime)#

     AND ModificationTime < #$(ThisExecTime)#;

Concatenate LOAD PrimaryKey, X, Y FROM File.QVD

WHERE NOT EXISTS(PrimaryKey);

Inner Join SQL SELECT PrimaryKey FROM DB_TABLE;

Please check carefully and adjust to your case.

Hope this helps.

/Andrei

[jonathandienst]

Can you post the script you are currently running?

[Anonymous]

Hi

FYI

QlikView training|Incremental Data Load in Qlikview - YouTube

[imhappiee]

Hi Ravi Kishore,

Hope this detailed explanation on Incremental load helps your problem get resolved

https://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

Anand

[#6]

Hi Andrei,

Thanks for your reply. Unfortunate is this solution is not working. I have tried the same.

Here are my data files attached. !

I am Receiving a separate Deleted Records File. Attached the files below.

If I am writing the Inner Join only those records which are in Deleted file are remaining.

Where has i would need to Delete the Records from the earlier QVD which has full set of records.

Is there any work around apart from this generic solution

Regards,

Ravi

[crusader_]

Hi,

In your case you need to change the order of your actions.

1. Load "Delete records.csv";

2. Load QVD where NOT EXISTS PrimaryKey; /// Here you'll get updated QVD file with deleted entries

3. Store new QVD file with deleted entries and DROP previous tables.

4. Use standard algorithm of INSERT-UPDATE Incremental load;

P.S. Don't forget to create backups of your QVD.

Hope this helps.

Regards,

Andrei

[#8]

Hi Jonathan,

I have uploaded the data files.

Please have a look and let me know how to implement the same.

The Deleted Records are given in a separate file has Deleted file.

I am using the Regular Incremental Load script with Inner Join, Which is not working as expected.

Regards,

Ravi

[jonathandienst]

If you want anyone to say what is wrong with your script, you need to upload your script. Not the data files.