topic Re: Sync All the Records Changed Transaction (CDC) to Target in Qlik Replicate

Sync All the Records Changed Transaction (CDC) to Target

cmlo — Fri, 13 Sep 2024 03:35:09 GMT

Hi All,

I'm new to Qlik Replicate.

I've a requirement to sync all the records changes historical data into target table.

The source is IBM DB2 for iSeries and we read from Journal (CDC).

I did configure the replication task to sync into target table. But, it update the latest record into target table instead of send all changes historical (CDC) data into target.

Could advised how should I send all the CDC historical changes data into target table? e.g: If 1 record get update 5 times and this captured in CDC. I want this 5 CDC records get sync into target table.

Re: Sync All the Records Changed Transaction (CDC) to Target

DesmondWOO — Fri, 13 Sep 2024 04:51:05 GMT

Hi @cmlo ,

Thank you for reaching out to the Qlik Community.

Could you check if the store changes meets your need? This feature stores operations/changes in the associated change table (__ct).

Regards,
Desmond

Re: Sync All the Records Changed Transaction (CDC) to Target

SachinB — Fri, 13 Sep 2024 07:11:44 GMT

Hello @cmlo ,

Just addition to @DesmondWOO details:

To capture and sync all historical change data (CDC) from IBM DB2 for iSeries into the target table using Qlik Replicate, Task will capture all changes (INSERT/UPDATE/DELETE) instead of just applying the latest change. This approach is typically called Change Data Capture (CDC) with history.

Here’s how you can achieve that:

1. Enable Full History Logging:

In Qlik Replicate, you can configure the task to store each change (insert, update, delete) as a separate row in the target table.
To do this, you need to enable Store Changes in the task settings.

Steps:

Go to the Replication Task settings.
Navigate to the Change Processing tab.
Check the option for Store Change Settings.
This will store a record for every insert, update, and delete operation in the target table, ensuring all historical changes are captured.

2. Track Operation Type (Insert, Update, Delete):

To distinguish between different change operations (inserts, updates, deletes), Qlik Replicate adds an operation indicator column to the target table. This helps you track whether a row was inserted, updated, or deleted.

Regards,

Sachin B

Re: Sync All the Records Changed Transaction (CDC) to Target

cmlo — Sat, 14 Sep 2024 12:54:32 GMT

Thank you. I'm able to get the historical changes records.