topic Re: Qlik Replicate Store changes with Oracle as source in Qlik Replicate

Qlik Replicate Store changes with Oracle as source

kdableeatt — Fri, 15 Nov 2024 23:17:44 GMT

Hi There,

I have a replication task with Oracle as a source and Azure Datalake Store (ADLS) as a target. The task is configured to store changes. When I inspect the __ct file for a source table, I see that the BEFOREIMAGE/UPDATE rows in the file do not have all the column values populated. The values were populated only for the columns that were updated. This isn't the case for SQL server as the source.

Sample data from the file:

"header__change_seq"Ç"header__change_oper"Ç"header__change_mask"Ç"header__stream_position"Ç"header__operation"Ç"header__transaction_id"Ç"header__timestamp"Ç"header__partition_name"Ç"ID"Ç"NAME"Ç"DESCRIPTION"
"20201120144058000000000000000000041"Ç"B"ÇÇ"000008d1.965eefa3.00000001.0009.01.0000:5279.298140.16"Ç"BEFOREIMAGE"Ç"07001B00000000000000000000000000"Ç2020-11-20 14:40:53.000000Ç"20201120T000000_20201121T000000"Ç6Ç"test_role_name"ÇNaN
"20201120144058000000000000000000041"Ç"U"Ç086200Ç"000008d1.965eefa3.00000001.0009.01.0000:5279.298140.16"Ç"UPDATE"Ç"07001B00000000000000000000000000"Ç2020-11-20 14:40:53.000000Ç"20201120T000000_20201121T000000"Ç6Ç"test desc-1 update"ÇNaN

The source table has three columns ID, NAME and DESCRIPTION. When an update on the NAME was issued for the ID=6, I see the change in the name is being captured but I do not see its corresponding DESCRIPTION in BEFOREIMAGE and UPDATE rows in the __ct file.

Am I missing a configuration/setting?

Re: Qlik Replicate Store changes with Oracle as source

Madhavi_Konda — Mon, 18 Jan 2021 21:07:00 GMT

Hi,

Please add the supplemental logging on ALL columns for this particular table on Oracle source and you will see all the records populated in the __ct table.

Thanks,

Madhavi

Re: Qlik Replicate Store changes with Oracle as source

kdableeatt — Mon, 18 Jan 2021 21:11:17 GMT

Thank you for the quick response.
I have the 'Automatically add supplemental logging' check box checked in the advanced config for the Oracle source connection in the replicate tool. I'm not sure if it is equivalent to enabling supplemental logging in the DB directly.
I'll give it a shot either ways and let you know.

Re: Qlik Replicate Store changes with Oracle as source

lyka — Fri, 22 Jan 2021 00:50:42 GMT

Hello,

Enabling "'Automatically add supplemental logging" will only turn on supplemental logging for PK columns. If you need all columns to be sent to the redo log, you need to enable supplemental logging for all columns

Thanks,

Lyka