topic Re: Duplicate records in QlikView

Duplicate records

Wed, 25 Nov 2020 16:16:04 GMT

Hi,

Is there any way i can look for duplicate record. I am having QVD and on daily basis i am getting a new records. If any of the record having duplicate entries when it compare with QVD during load then details of duplicate records need to be send via alert email.

Please let me know is this case can be handled.

Thanks,

Rohit

Re: Duplicate records

Michiel_QV_Fan — Tue, 11 Apr 2017 09:37:48 GMT

Do you need the duplicate in your data? If not, is filtering out an option?

Re: Duplicate records

Siva_Sankar — Tue, 11 Apr 2017 09:56:45 GMT

Rohit,

We discussed this yesterday, did you try that solution To see the duplicate records in qlikview

Siva

Re: Duplicate records

Tue, 11 Apr 2017 10:03:27 GMT

Hi Siva,

I tried it yesterday and it working fine. I am looking for you input, does the same logic can be applied with QVD and daily input excel file.

I am asking this because my QVD have millions of data and during load each records need to be searched for duplicate records. Is this can be possible.

Thanks,

Rohit

Re: Duplicate records

hector_munoz — Tue, 11 Apr 2017 10:04:28 GMT

Hi Rohit,

You can create a new resident table in your model that contains those duplicated records. A simple way is grouping by a key, counting and later filtering those with a count grater than 1.

I attach you a sample. Hope it helps you!

Regards,

Re: Duplicate records

Siva_Sankar — Tue, 11 Apr 2017 10:14:01 GMT

Yes, Rohit.

You can do irrespective of the source. Because we are handling it in the front end. But what is the perspective of showing duplicate records in a chart. While loading itself you can remove those existing records using Exist function.

Siva

Re: Duplicate records

Tue, 11 Apr 2017 11:19:31 GMT

Hi Siva,

User wants to know what all the incorrect data in the input file. So details of duplicate data need to be send to them via email.

Thanks,

Rohit

Re: Duplicate records

Siva_Sankar — Tue, 11 Apr 2017 14:31:56 GMT

Hi Rohit,

Find the attached document, I have created a flag to identify duplicates while loading the data. You can use this approach to compare any number of records.

Siva