topic How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log in Qlik Replicate

How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Tue, 03 Oct 2023 14:44:26 GMT

Hi Team,

How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log. In our case we have enabled Archive Log Mode and capturing Logs for Qlik to read and process for CDC.

Guide us the steps to configure "Replicate Log Reader" Option for better CDC

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

Heinvandenheuvel — Tue, 03 Oct 2023 15:52:26 GMT

I'm not sure I understand your question.

The way I read it, the Oracle source does not have ASM, yet judging by the attached error picture a username/password for ASM was provided. Just do NOT provide anything, leave it blank!

If that's not the correct interpretation of the question then please try to re-word and let someone in your team read it to see if they understand correctly what you are asking. Provide picture of 'advanced' connection page if needed. Better still, provide the 'databases' section from the JSON from a task or full system export.

hth,
Hein.

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

sanjeevbind — Tue, 03 Oct 2023 20:06:00 GMT

@Heinvandenheuvel

You got it right that Oracle Source does not have ASM setup, and we want to use Replicate Log Reader. However, when we select Replicate Log Reader, it gives error as mentioned below. But we have kept everything blank as you can see in the 2nd screenshot given below. Please note that it is working when we are using Oracle Log Miner. Please suggest what is wrong here.

Error Message:

Oracle Source Endpoint Advanced Setting Page:

@pavan_peri

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

Heinvandenheuvel — Wed, 04 Oct 2023 02:28:09 GMT

That setup looks good and it should NOT go to ASM.

Same error pops when you 'TEST' the endpoint?

What Replicate version?

Perhaps you can share the REPTASK__xxx.log or relevant section from REPSRV.LOG (for the TEST command)

What does the endpoint JSON look like? It should be something like:

"db_settings": { "$type": "OracleSettings", "username": "att_user", "password": "{ZA681E2BDB60C4EA643FF8A0835EA3226EAB79AAAE419812BF}", "server": "localhost:1521/XEPDB1", "useLogminerReader": false, "retryInterval": 30, "accessAlternateDirectly": false, "alternateFolder": "/oraarch/prd7", "skipValidationLongNames": true }

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Wed, 04 Oct 2023 05:14:17 GMT

Hi Hein,

Below are the details that you have asked for and attached are the logs for reference.

Version: V2023.5.0.152

JSON Structure of our DB Settings are for your referece:

"databases": [{
"name": "Oracle CDC Log Reader",
"role": "SOURCE",
"is_licensed": true,
"type_id": "ORACLE_COMPONENT_TYPE",
"db_settings": {
"$type": "OracleSettings",
"username": "REP",
"password": "{ZAA4F40F919BACA4AE1120631CD584F59F14D6E962D084DDC5}",
"server": "//localhost:1545/ABCDE",
"useLogminerReader": false,
"accessAlternateDirectly": false,
"archivedLogDestId": 5,
"nlsCharsetId": 871,
"additionalArchivedLogDestId": 5,
"allowSelectNestedTables": true,
"replicateInvisibleColumns": true
},
"override_properties": {
}

In our case we are not using ASM, when tested connectivity tests, we are good and Qlik Task can connect to both Oracle as Source & Azure SQL as Target without any issues.

Test 1: For the Same task we have changed the settings from Replicate Log Reader to LogMiner and test the case where it worked well. Log file is attached.

Test 2: Changed Advanced Task Settings to "Replicate Log Reader", tested the connectivity and then tried starting the task. Unfortunately Task is not starting for which both log and snapshot is attached for review.

Appreciate your help here to solve the issue.

Summary:

We have tested Migration & Replication using Log Miner which works well. Our goal is to setup and test the same using Replicate Log Reader option. While trying that we are facing issue as explained.

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Wed, 04 Oct 2023 05:26:32 GMT

Hi Hein,

Attached another test log for review along with snapshot where we get error as TCP Error surprisingly, but when tested the connection, it works well and says Connection Successful.

Await your guidance to solve this please.

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

SushilKumar — Wed, 04 Oct 2023 09:22:42 GMT

Hello Team,

Seems you need to raise a case with TSE for further analysis. Share the task Diagnostics package along with case.

As Qlik replicate fetch all the information from the database itself.

Regards,

Sushil Kumar

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Wed, 04 Oct 2023 09:29:43 GMT

Hi Sushil,

We are happy to do this, before we want to raise the case we would like to know why Qlik is unable to connect to Oracle when "Replicate Log Reader" Option is selected? The same task works fine when "LogMiner is selected"

Would like to know what could be the issue and the rest.. hope you have reviewed our logs?

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Wed, 04 Oct 2023 11:47:52 GMT

Hi Sushil,

As suggested, i have raised a case. Please refer to the case # 00116167 more more details.

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

Heinvandenheuvel — Wed, 04 Oct 2023 12:07:20 GMT

Thanks for the JSON. There is this "archivedLogDestId": 5,... "additionalArchivedLogDestId": 5,

I guess that's deliberate? RAC? Leftover?

I also noticed the // on the source endpoint connection string that's not very common to be used. I tried ion my own server and it does not seem to make a difference. So no issue.

Maybe there is something odd about the source DB, do you have an other one to connect to , just an Express edition if you have to?

Next time, maybe run with LOGGING SOURCE_CAPTURE VERBOSE to hopefully get relevant details. Kill after first errors.

Finally, but I suppose that has effectively already happened while trying. Start a fresh endpoint and task from scratch, using simple short names. Same thing?

Hein

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Wed, 04 Oct 2023 12:15:54 GMT

Hi Hein,

To answer you point:

I guess that's deliberate? RAC? Leftover? -- Our Oracle is an Enterprise Database but not RAC. This Json we got it when we created a task and exported it. Haven't modified any. (Original Export of Task as Json)

Maybe there is something odd about the source DB, do you have an other one to connect to , just an Express edition if you have to? -- Migration & Replication works fine when LogMiner is selected as an option for which we have attached the logs for reference. As there is no ASM we have left all options which you have also acknowledged as correct.

Next time, maybe run with LOGGING SOURCE_CAPTURE VERBOSE to hopefully get relevant details. Kill after first errors. -- We will try and test this and share the logs as suggested

Finally, but I suppose that has effectively already happened while trying. Start a fresh endpoint and task from scratch, using simple short names. Same thing? -- Tried all these as couple of TEST Tasks and played with it. No use when used "Replicate Log Reader" and work fine when selected "LogMiner"

Hope this helps

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Wed, 04 Oct 2023 12:16:39 GMT

Hi Hein,

The version what we use is "V2023.5.0.152". Hope there are no issues with this version?

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Wed, 04 Oct 2023 13:25:07 GMT

Hi Hein,

Attached are the logs with SOURCE_CAPTURE VERBOSE and Diagnostics Pack for reference

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

Heinvandenheuvel — Wed, 04 Oct 2023 17:36:09 GMT

>>> Attached are the logs with SOURCE_CAPTURE VERBOSE and Diagnostics Pack for reference

Thanks. That helps.

[SOURCE_CAPTURE ]V: Going to retrieve online REDO log with sequence '30' RLID '1135785205', thread '1' (ora
[SOURCE_CAPTURE ]T: Going to open Redo Log with original name '+DATA_A/oradata/gwdtst01/log02a.dbf', thread
[SOURCE_CAPTURE ]T: Connect ASM: Connecting to Oracle ASM server (user '', Redo thread '1' OCI Thread '0' o
[SOURCE_CAPTURE ]T: OCI error 'ORA-12560: TNS:protocol adapter error' [1022307] (oradcdc_redoutil.c:518)

So while you topic text mentions that the ARCHIVE is not on ASM, the REDO actually is on ASM as the +DATA indicates. WTF!? So give it proper ASM access! Or maybe some renaming must take place? : Use path as it appears in the database Replace path prefix

I suppose you could try switch your task to 'Use archived redo logs only' but that doesn't sit right to me, and you would likely not like the LATENCY that you get with that.

Hein.

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

john_wang — Thu, 05 Oct 2023 02:04:08 GMT

Hello @pavan_peri ,

Besides @Heinvandenheuvel comment, I'd like to remind you that you are running an incompatible Oracle client and Oracle server versions. See the task log file lines #37-39:

2023-10-04T06:39:06 [SOURCE_CAPTURE ]I: Oracle source database version is 11.2.0.4.0
2023-10-04T06:39:06 [SOURCE_CAPTURE ]I: Oracle Client version: 21.10.0.0.0
2023-10-04T06:39:06 [SOURCE_CAPTURE ]I: Oracle compatibility version is 11.2.0.4.0

Oracle does not support these versions combination:

Oracle client versions 12.2/18c/19c are recommended.

Maybe this is not the root cause of the error message, however an uncertified version may lead to unpredictable results.

Regards,

John.

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Thu, 05 Oct 2023 04:43:42 GMT

Hi Hein,

Thanks a lot for your inputs and observations. We are internally checking with DBA to get back to us with possible output so that can test and update you.

Re: How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

pavan_peri — Thu, 05 Oct 2023 04:44:49 GMT

Hi John,

Thanks a lot for your inputs. Will check with client and see what best can be done. Will keep you posted on the same.