we are using Qlik Replicate & Qlik Compose to replicate the data from Oracle to Databricks Delta lake.
We have a unique problem with one of our tables.
A record that was last updated in the source table more than a year back keeps getting updated by Qlik Replicate multiple times daily in the databricks tables.
Welcome to Qlik Community forum and thanks for reaching out here!
It appears that a specific record was updated or an event triggered a DML operation in the Oracle source database. To resolve this issue, please follow these steps:
1- Set SOURCE_CAPTURE and TARGET_APPLY to Verbose in the task logging configuration
2- Add the internal parameter keepCSVFiles to the Databricks Delta target endpoint and set its value to TRUE.
After the issue is reproduced, set the logging level back to the default. Then, examine the CSV files (under Qlik Replicate Server task subfolder) and task log files (e.g., by searching for the specific record's primary key values or distinctive strings) to identify the root cause.
Hope this helps.
John.
Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
We had raise a case with Qlik Support and their recommendation was to install the latest patch for Qlik Replicate.
This was the below statement from Qlik Support
First from reviewing the diagnostic pakcage I see that you are running Replicate 2023.5 PR02. In Pr03 there was a fix to a product issue (RECOB-7458) that potentially was causing missing events in the Databrick endpoint target.
To eliminate the effect of this product issue please upgrade to latest patch release of 2023.5 (PR06).
