Oracle to Qlik Replicate - missing data issue

jorgetrillo — Thu, 08 Sep 2022 13:11:27 GMT

Summary

We had a extraction with Qlik Replicato from a Oracle Database which was going well.
Now we changed version Oracale Database from 12c to 19c
Now we have a problem. We are missing data
In the screeshot bellow we can see in the left side what we have in our databse and in the right side what Qlik is extracting.

Setup

We currently have Qlik Replicate installed on windows application server.
The End point of an Oracle 19c Database
CDC task setup – to capture data from the source & create a csv file of any inserts / updates / deletes.

Events to issue

The database was upgraded from 12c to 19c.
From the Attunity side – all that changed on the task was the end point – to point to the new database.
All other aspects of the tasks remained unchanged
Supplemental logging was turned on the database side – at a table level (exact DB setup to come)

Issue

Data was flowing through Qlik Replicate, however we noticed that some tables were not in sync with the source table – some Inserted / Deleted records missing.

Sample table example

Below is analysis of 1 table / 1 day (table POLICY_ENTITY for 31-AUG-2022)

Data on the left is the source entries – on the Oracle Database table
Data on the right is the records wrote by Qlik Replicate to the server (csv’s combined into excel sheet for analysis)
There are many records on the source (highlighted in orange) that were not wrote to the attunity server
Thin includes both Inserts and Deletes

Task that contains this table we are analysing – (XCLOUD_DE_TIA_TRANS_CDC) is attached – this contains multiple table – including the sample table POLICY_ENTITY from above

Also attached the Memory report and Diagnostic report – from the above task

Re: Oracle to Qlik Replicate - missing data issue

Steve_Nguyen — Thu, 08 Sep 2022 13:47:25 GMT

1. i see that you are on version : V6.6.0.904 this has end of life, since then we have release 7.0 , 2021, and now 2022.5 kit that has fixed many Oracle issue.

https://community.qlik.com/t5/Product-Support-Lifecycle/Qlik-Replicate-Product-Lifecycle/ta-p/1837201

2. we see warning on the log :

00006936: 2022-09-03T21:37:25 [SOURCE_CAPTURE ]W: The access to Oracle view v$containers is not permitted (oracle_endpoint_conn.c:1023)
00006936: 2022-09-03T21:37:25 [SOURCE_CAPTURE ]W: Resetlog process cannot be supported because the access to v$database_incarnation is not permitted

3. look like you have encrypted column :

00006936: 2022-09-04T08:18:43 [ASSERTION ]W: The Redo log '/dbdata/PRCTIA01/PRCTIA01_redo51.lgf' contains both encrypted and unencrypted events for table 'SYS.OBJ$', only unencrypted events will be captured (oradcdc_parse.c:228)
00006936: 2022-09-04T08:18:43 [ASSERTION ]W: If you do not know the correct “Secret store encryption entries”, enter any Oracle Secret Store tablespace/database key and value, and then resume the task. If the wrong key was specified, an error with the correct key will be returned (

===

please try and plan for upgrade to 7.0 then 2021 and then to current 2022 version.

for the data to be in synch, you would have do a reload

topic Re: Oracle to Qlik Replicate - missing data issue in Qlik Replicate

Oracle to Qlik Replicate - missing data issue

Re: Oracle to Qlik Replicate - missing data issue