Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
narashan
Contributor
Contributor

Qlik Replicate - Hash based compare

Wanted to confirm if Qlik Replicate uses hashing algorithm and comparison to check for changes to a data element/record to identify a CDC/update? 

This is important especially when there are LOBs in the table that gets updated and the hash check would degrade performance.  

\

Thank you PadmaPriya...want to make sure that the question is clear:

We have a database (DB2) that has CLOB elements with JSON data. We have enabled CDC from the DB2 instance to S3. The question is to confirm  and understand how Qlik recognises a change to this CLOB. For e.g., there is an update to a specific record and the JSON in the CLOB is the only element updated, but there was no change to the JSON it was identical to the previous one...

So will Qlik recognise that 1) There was an update, 2) only one column was updated, 3) do a hash compare to ensure that the value has changed, 4) if the JSONs are identical before and after update then the hash values would be same, 5) Qlik will not trigger an update CDC for this record since nothing changes, 6) If Qlik is not doing a data compare on update then after step #2 above it will just replicate the record with operation code "Update"

Labels (2)
2 Replies
PadmaPriya
Support
Support

Hello @narashan 

 

Please refer to below articles:

https://help.qlik.com/en-US/replicate/November2020-SR1/Content/Global_Common/Content/SharedEMReplica...

https://www.qlik.com/us/products/qlik-replicate

https://community.qlik.com/t5/QlikView-App-Dev/Key-field-generation-methods-comparison/td-p/1410504

 

Thanks,

Padma Priya

Help users find answers! Don't forget to mark a solution that worked for you! If already marked, give it a thumbs up!
narashan
Contributor
Contributor
Author

Thank you...want to make sure that the question is clear:

We have a database (DB2) that has CLOB elements with JSON data. We have enabled CDC from the DB2 instance to S3. The question is to confirm  and understand how Qlik recognises a change to this CLOB. For e.g., there is an update to a specific record and the JSON in the CLOB is the only element updated, but there was no change to the JSON it was identical to the previous one...

So will Qlik recognise that 1) There was an update, 2) only one column was updated, 3) do a hash compare to ensure that the value has changed, 4) if the JSONs are identical before and after update then the hash values would be same, 5) Qlik will not trigger an update CDC for this record since nothing changes, 6) If Qlik is not doing a data compare on update then after step #2 above it will just replicate the record with operation code "Update"