topic Re: Remove Duplicates in a Table(QlikView) in QlikView

Remove Duplicates in a Table(QlikView)

Anonymous — Wed, 25 Nov 2020 16:16:04 GMT

I have a multiple documents with same field names(have 38 Fields). Each file have around 10 Lakh data. There are duplication across the files and also with in each file.

Now the requirement is I need to create a single file with all 38 columns by removing the duplicates. Removing the duplicate should be based on ID field. If ID is repeated we should only keep very 1st row and rest of the repeated rows can be deleted. it is not necessary to check the rest of the 37 fields. i.e., even if other columns vary still we are fine to delete the respective rows.

Let me know how can we achieve this in QlikView

Re: Remove Duplicates in a Table(QlikView)

YoussefBelloum — Wed, 09 May 2018 10:10:06 GMT

Hi,

would you be able to attach sample data to make tests ?

Re: Remove Duplicates in a Table(QlikView)

jubarrosor — Wed, 09 May 2018 10:26:00 GMT

Hi Vinoth:

You can use the function exists:

https://community.qlik.com/thread/79917

https://help.qlik.com/es-ES/sense/September2017/Subsystems/Hub/Content/Scripting/InterRecordFunctions/Exists.htm

Best Regards,

Juan P. Barroso

Re: Remove Duplicates in a Table(QlikView)

Anonymous — Wed, 09 May 2018 10:47:31 GMT

Hi Youssef,

Please refer the enclosed files. i have enclosed 3 dummy files. We should consider only NPI (Column 1)