Duplicate records

[#1]

Hi,

Is there any way i can look for duplicate record. I am having QVD and on daily basis i am getting a new records. If any of the record having duplicate entries when it compare with QVD during load then details of duplicate records need to be send via alert email.

Please let me know is this case can be handled.

Thanks,

Rohit

[Michiel_QV_Fan]

Do you need the duplicate in your data? If not, is filtering out an option?

[Siva_Sankar]

Rohit,

We discussed this yesterday, did you try that solution To see the duplicate records in qlikview

Siva

[#4]

Hi Siva,

I tried it yesterday and it working fine. I am looking for you input, does the same logic can be applied with QVD and daily input excel file.

I am asking this because my QVD have millions of data and during load each records need to be searched for duplicate records. Is this can be possible.

Thanks,

Rohit

[hector_munoz]

Hi Rohit,

You can create a new resident table in your model that contains those duplicated records. A simple way is grouping by a key, counting and later filtering those with a count grater than 1.

I attach you a sample. Hope it helps you!

Regards,

H

[Siva_Sankar]

Yes, Rohit.

You can do irrespective of the source. Because we are handling it in the front end. But what is the perspective of showing duplicate records in a chart. While loading itself you can remove those existing records using Exist function.

Siva

[#7]

Hi Siva,

User wants to know what all the incorrect data in the input file. So details of duplicate data need to be send to them via email.

Thanks,

Rohit

[Siva_Sankar · Accepted solution]

Hi Rohit,

Find the attached document, I have created a flag to identify duplicates while loading the data. You can use this approach to compare any number of records.

Siva