topic How to remove duplicate records with appending current date (Today's date) in QlikView

How to remove duplicate records with appending current date (Today's date)

Supriya_123 — Mon, 23 Dec 2019 07:08:17 GMT

Hi,

Basically the data which I want to display on the dashboard resides in SAP. We created the QVD file for the SAP data. When I reload it for first time It loads all the data but After some time when we do changes in QVD file and try to reload the data it creates duplicates of original data . Also I want to load Today's data appending with previous data.

Eg: 1)Suppose my QVD file is containing 20 records, when I reload it first it happens properly..I am able to see the 20 records as it is. But when I make some changes in the qvd file and reload the data again, I am getting 40 records. The breakup is 20 previous ones and 20 duplicate records. Is there any solution to avoid this

2)So I want to create the QVD file in such a fashion that the new data (today's sap data)gets appended to the old data(previous sap data in file). Any solution on this

Re: How to remove duplicate records with appending current date (Today's date)

alex00321 — Tue, 24 Dec 2019 13:54:54 GMT

Hi, you could try to use "Incremental Load" followed by the blog here:

https://www.tutorialspoint.com/qlikview/qlikview_incremental_load.htm

Thanks!

Re: How to remove duplicate records with appending current date (Today's date)

Brett_Bleess — Thu, 26 Dec 2019 16:08:42 GMT

In addition to Alex's post, here is the Help on Incremental loading in QVD files:

https://help.qlik.com/en-US/qlikview/April2019/Subsystems/Client/Content/QV_QlikView/QVD_Incremental.htm

And here is a Design Blog post as well:

https://community.qlik.com/t5/Qlik-Design-Blog/Overview-of-Qlik-Incremental-Loading/ba-p/1466780

Regards,
Brett