topic Re: Handling duplicates and validations in Qlik replicate in Qlik Replicate

Handling duplicates and validations in Qlik replicate

suvbin — Tue, 31 Jan 2023 07:58:45 GMT

Hi Team,

How to handle duplicate records or duplicate tables in Qlik replicate. Also how to validate the data once ingested into the target database.

Thanks.

Re: Handling duplicates and validations in Qlik replicate

KellyHobson — Tue, 31 Jan 2023 10:29:48 GMT

Hey @suvbin ,

Here are some helpful articles about troubleshooting duplicate data:

1. Troubleshooting guide

2. Duplicate rows when doing a full load

3. See reply about cacheing on this question

For validating in the target db, this depends on the target endpoint type but generally is set of queries to check for duplicate records.

Example:

SELECT column1, column2, count(*)
FROM table_name
GROUP BY column1, column2
HAVING count(*) > 1;

This query will return all rows that have duplicate values in column1 and column2. The count column will show the number of duplicates for each group.

Best,

Kelly

Re: Handling duplicates and validations in Qlik replicate

Bill_Steinagle — Fri, 03 Feb 2023 15:57:46 GMT

@suvbin

Thank you for the post and as per the update from @KellyHobson can you confirm this as a Solution? Please let us know.

Thanks!

Bill