Oracle to Qlik Replicate - missing data issue

[jorgetrillo]

Summary

• We had a extraction with Qlik Replicato from a Oracle Database which was going well.
• Now we changed version Oracale Database from 12c to 19c
• Now we have a problem. We are missing data
• In the screeshot bellow we can see in the left side what we have in our databse and in the right side what Qlik is extracting.

Setup

• We currently have Qlik Replicate installed on windows application server.
• The End point of an Oracle 19c Database
• CDC task setup – to capture data from the source & create a csv file of any inserts / updates / deletes.

Events to issue

• The database was upgraded from 12c to 19c.
• From the Attunity side – all that changed on the task was the end point – to point to the new database.
• All other aspects of the tasks remained unchanged
• Supplemental logging was turned on the database side – at a table level (exact DB setup to come)

Issue

• Data was flowing through Qlik Replicate, however we noticed that some tables were not in sync with the source table – some Inserted / Deleted records missing.

Sample table example

• Below is analysis of 1 table / 1 day (table POLICY_ENTITY for 31-AUG-2022)
• Data on the left is the source entries – on the Oracle Database table
• Data on the right is the records wrote by Qlik Replicate to the server (csv’s combined into excel sheet for analysis)
• There are many records on the source (highlighted in orange) that were not wrote to the attunity server
• Thin includes both Inserts and Deletes

• Task that contains this table we are analysing – (XCLOUD_DE_TIA_TRANS_CDC) is attached – this contains multiple table – including the sample table POLICY_ENTITY from above

• Also attached the Memory report and Diagnostic report – from the above task

[Steve_Nguyen · Accepted solution]

1. i see that you are on version : V6.6.0.904  this has end of life, since then we have release 7.0 , 2021, and now 2022.5 kit that has fixed many Oracle issue.

https://community.qlik.com/t5/Product-Support-Lifecycle/Qlik-Replicate-Product-Lifecycle/ta-p/183720...

2. we see warning on the log :

00006936: 2022-09-03T21:37:25 [SOURCE_CAPTURE  ]W:  The access to Oracle view v$containers is not permitted  (oracle_endpoint_conn.c:1023)
00006936: 2022-09-03T21:37:25 [SOURCE_CAPTURE  ]W:  Resetlog process cannot be supported because the access to v$database_incarnation is not permitted

3. look like you have encrypted column :

00006936: 2022-09-04T08:18:43 [ASSERTION       ]W:  The Redo log '/dbdata/PRCTIA01/PRCTIA01_redo51.lgf' contains both encrypted and unencrypted events for table 'SYS.OBJ$', only unencrypted events will be captured  (oradcdc_parse.c:228)
00006936: 2022-09-04T08:18:43 [ASSERTION       ]W:  If you do not know the correct “Secret store encryption entries”, enter any Oracle Secret Store tablespace/database key and value, and then resume the task. If the wrong key was specified, an error with the correct key will be returned  (

===

please try and plan for upgrade to 7.0  then 2021 and then to current 2022 version.

for the data to be in synch, you would have do a reload