Elimination or omit duplicates

Tue, 06 Sep 2016 06:10:30 GMT

Hello everybody,

I have a QVD with data from Jan 04th 2016 until last Sunday. Since it does not make sense, to read the entire values from Jan 04th 2016 every week simply the last week is added to the existing QVD (with Concatenate command). So far so good.

Now I would like to read not only the last week, but Sunday again, because for this there are mostly still missing data, which are only gradually recorded during the week. That's why I have a lot of duplicate records that I didn't need in the QVD because this indeed falsify values.

Is it possible to detect and omit these duplicates when reading the data by the script or afterwards? And if so, how?

Thank you and best regards,

Hagen

Re: Elimination or omit duplicates

krishnacbe — Tue, 06 Sep 2016 15:44:37 GMT

Hi,

You can implement Incremental Load logic.

incremental load types

https://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

Hope this helps

Re: Elimination or omit duplicates

Thu, 08 Sep 2016 06:49:02 GMT

That works great

Thank you!

topic Elimination or omit duplicates in QlikView

Elimination or omit duplicates

Re: Elimination or omit duplicates

Re: Elimination or omit duplicates