Handling duplicates and validations in Qlik replicate

[suvbin]

Hi Team,

How to handle duplicate records or duplicate tables in Qlik replicate. Also how to validate the data once ingested into the target database.

Thanks.

[KellyHobson · Accepted solution]

Hey @suvbin ,

Here are some helpful articles about troubleshooting duplicate data:

1. Troubleshooting guide

2. Duplicate rows when doing a full load

3. See reply about cacheing on this question 

For validating in the target db, this depends on the target endpoint type but generally is set of queries to check for duplicate records.

Example:

SELECT column1, column2, count(*)
FROM table_name
GROUP BY column1, column2
HAVING count(*) > 1;

This query will return all rows that have duplicate values in column1 and column2. The count column will show the number of duplicates for each group.

Best,

Kelly

[Bill_Steinagle]

@suvbin 

Thank you for the post and as per the update from @KellyHobson can you confirm this as a Solution? Please let us know.

Thanks!

Bill