Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
Supriya_123
Contributor
Contributor

How to remove duplicate records with appending current date (Today's date)

Hi,

Basically the data which I want to display on the dashboard resides in SAP.  We created the QVD file for the SAP data.  When I reload it for first time It loads all the data but After some time when we do changes in QVD file and try to reload the data it creates duplicates of original data . Also I want to load Today's data appending with previous data. 

 

Eg: 1)Suppose my QVD file is containing 20 records, when I reload it first it happens properly..I am able to see the 20 records as it is. But when I make some changes in the qvd file and reload the data again, I am getting 40 records. The breakup is 20 previous ones and 20 duplicate records. Is there any solution to avoid this

 

2)So I want to create the QVD file in such a fashion that the new data (today's sap data)gets appended to the old data(previous sap data in file). Any solution on this

2 Replies
alex00321
Creator II
Creator II

Hi, you could try to use "Incremental Load" followed by the blog here:

https://www.tutorialspoint.com/qlikview/qlikview_incremental_load.htm

 

Thanks!

Brett_Bleess
Former Employee
Former Employee

In addition to Alex's post, here is the Help on Incremental loading in QVD files:

https://help.qlik.com/en-US/qlikview/April2019/Subsystems/Client/Content/QV_QlikView/QVD_Incremental...

And here is a Design Blog post as well:

https://community.qlik.com/t5/Qlik-Design-Blog/Overview-of-Qlik-Incremental-Loading/ba-p/1466780

Regards,
Brett

To help users find verified answers, please do not forget to use the "Accept as Solution" button on any post(s) that helped you resolve your problem or question.
I now work a compressed schedule, Tuesday, Wednesday and Thursday, so those will be the days I will reply to any follow-up posts.