Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Talend Cloud AWS EU Scheduled Outage: Starting Tues 26 May 21:00 CEST with expected completion Wed 27 May 01:00 CEST
cancel
Showing results for 
Search instead for 
Did you mean: 
MoeE
Partner - Specialist
Partner - Specialist

Finding duplicates in a change table

Hi,

We have a scenario where a change table missed some records a couple of weeks back. Fortunately, we have the option to resume from a timestamp in order to recover those records. The issue with this is that the changes are going to be replayed thus causing duplicates in the change table. (This is a change table only task btw)

In order to identify duplicates in the change table, is there a recommended way to do so? So far in my testing, I've identified the column header__stream_position, which looks like it should be unique for each change in the table. Can I use that to identify duplicates?

Help with this is greatly appreciated as always. Thank you.

 

Labels (1)
1 Solution

Accepted Solutions
john_wang
Support
Support

Hello @MoeE ,

You are right. The column header__stream_position is the only column can be used to identify a unique row in Change Table.

Regards,

John.

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!

View solution in original post

3 Replies
john_wang
Support
Support

Hello @MoeE ,

You are right. The column header__stream_position is the only column can be used to identify a unique row in Change Table.

Regards,

John.

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
MoeE
Partner - Specialist
Partner - Specialist
Author

Hi John,

Thanks for the assistance as always. Have a good day.

Regards,

Mohammed

john_wang
Support
Support

Thank you so much for your great support Mohammed @MoeE !

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!