topic Re: Concatenate CSV file every time it updates (eliminate duplicates) in App Development

Concatenate CSV file every time it updates (eliminate duplicates)

XMERINO — Mon, 02 May 2022 18:52:08 GMT

Hi,

Looking to join CSV file every time it is updated with newer data. however i do not want to loose historic data stored in Qlik Sense and want to eliminate duplicates as there may be an overlap in time when data is run. The data will always have the same fields (columns) but with different information on them.

Can someone help!

Please and thank you!!!!

Xavier

Re: Concatenate CSV file every time it updates (eliminate duplicates)

brunobertels — Tue, 03 May 2022 06:35:33 GMT

look in the forum or help page for incremetal load :

"Incremental load is defined as the activity of loading only new or updated records from the database into an established QVD. Incremental loads are useful because they run very efficiently when compared to full loads, particularly so for large data sets."

Incremental load for beginner with example - Qlik Community

Loading new and updated records with incremental load ‒ Qlik Sense