topic To see the duplicate records in qlikview in QlikView

To see the duplicate records in qlikview

Wed, 25 Nov 2020 16:16:04 GMT

Hi,

I am having QVD with below data till yesterday.

Products	Customer ID	Transaction Date	Sales Qty	Sales Amount	Country Code
A	10	01-15-2016	1	10	US
B	11	01-15-2016	2	20	US
C	12	01-15-2016	3	30	UK
D	13	02-15-2016	2	20	IR
E	15	02-15-2016	3	30	US
F	16	02-15-2016	5	50	US
G	17	03-15-2016	2	20	UK
H	18	03-15-2016	6	60	IR

Today i have received below records(having 3 duplicate records), then that should not be loaded in QVD and the duplicate records need to be notified via email. Is this possible? Please advise.

Products	Customer ID	Transaction Date	Sales Qty	Sales Amount	Country Code
A	10	01-15-2016	1	10	US
B	11	01-15-2016	2	20	US
I	19	03-15-2016	7	70	US
J	20	03-15-2016	8	80	US
K	21	04-15-2016	1	10	UK
L	22	04-15-2016	4	40	IR
M	23	04-15-2016	5	50	US
H	18	03-15-2016	6	60	IR

Thanks in advance!!

Rohit

Re: To see the duplicate records in qlikview

ahaahaaha — Mon, 10 Apr 2017 06:58:05 GMT

Hi Rohit,

Do you apply an incremental load or just load information from files QVD?

Regards,

Andrey

Re: To see the duplicate records in qlikview

Anonymous — Mon, 10 Apr 2017 07:00:49 GMT

Rohit,

You can use distinct or any alternatives of distinct while loading the data into qvd. And then you can list the duplicate records using count(1)>1 grouping by the grain of the table and to send mail Send mail and Export in Qlikview will help you.

Re: To see the duplicate records in qlikview

Mon, 10 Apr 2017 07:02:05 GMT

Yes incremental load is required, but i want to know once the duplicate records has been identified during load, then the records detail need to be shared via email.

Thanks,

Rohit

Re: To see the duplicate records in qlikview

beck_bakytbek — Mon, 10 Apr 2017 07:22:14 GMT

Hi Rohit,

check this: https://community.qlik.com/thread/70101

i hope that helps

beck

Re: To see the duplicate records in qlikview

Siva_Sankar — Mon, 10 Apr 2017 08:22:35 GMT

Hi Rohit,

find the attached application showing duplicate records in seperate table. I already created a document on how to create alert and send email (Without macro). Please read the document here CREATING AUTOMATED ALERTS AND EMAILS SENDING BASED ON DATA LOADED IN QLIKVIEW.docx

Re: To see the duplicate records in qlikview

Mon, 10 Apr 2017 10:27:57 GMT

Thanks Sivasankar,

Could you please help how this will work when we have history file(huge data) in QVD and daily normal file. Is it possible to have comparison of the new records with historical one(QVD). And alert will generate once we have any duplicate record.

Thanks,

Rohit