How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log

[pavan_peri]

Hi Team,

How do we configure Replicate Log Reader on Qlik Replicate when there is no ASM Build for Archive Log. In our case we have enabled Archive Log Mode and capturing Logs for Qlik to read and process for CDC.

Guide us the steps to configure "Replicate Log Reader" Option for better CDC

[Heinvandenheuvel]

I'm not sure I understand your question. 

The way I read it, the Oracle source  does not have ASM, yet judging by the attached error picture a username/password for ASM was provided. Just do NOT provide anything, leave it blank!

If that's not the correct interpretation of the question then please try to re-word and let someone in your team read it to see if they understand correctly  what you are asking. Provide picture of 'advanced' connection page if needed. Better still, provide the 'databases' section from the JSON from a task or full system export.

hth,
Hein.

[sanjeevbind]

@Heinvandenheuvel 

You got it right that Oracle Source does not have ASM setup, and we want to use Replicate Log Reader. However, when we select Replicate Log Reader, it gives error as mentioned below. But we have kept everything blank as you can see in the 2nd screenshot given below. Please note that it is working when we are using Oracle Log Miner. Please suggest what is wrong here.

Error Message:

Oracle Source Endpoint Advanced Setting Page:

 @pavan_peri 

[Heinvandenheuvel]

That setup looks good and it should NOT go to ASM.

Same error pops when you 'TEST' the endpoint?

What Replicate version?

Perhaps you can share the REPTASK__xxx.log  or relevant section from REPSRV.LOG (for the TEST command)

What does the endpoint JSON look like? It should be something like:

"db_settings":	{
	"$type":	"OracleSettings",
	"username":	"att_user",
	"password":	"{ZA681E2BDB60C4EA643FF8A0835EA3226EAB79AAAE419812BF}",
	"server":	"localhost:1521/XEPDB1",
	"useLogminerReader":	false,
	"retryInterval":	30,
	"accessAlternateDirectly":	false,
	"alternateFolder":	"/oraarch/prd7",
	"skipValidationLongNames":	true
}

[pavan_peri]

Hi Hein,

Below are the details that you have asked for and attached are the logs for reference.

Version: V2023.5.0.152

JSON Structure of our DB Settings are for your referece:

"databases":  [{
        "name":  "Oracle CDC Log Reader",
        "role":  "SOURCE",
        "is_licensed":  true,
        "type_id":  "ORACLE_COMPONENT_TYPE",
        "db_settings":  {
          "$type":  "OracleSettings",
          "username":  "REP",
          "password":  "{ZAA4F40F919BACA4AE1120631CD584F59F14D6E962D084DDC5}",
          "server":  "//localhost:1545/ABCDE",
          "useLogminerReader":  false,
          "accessAlternateDirectly":  false,
          "archivedLogDestId":  5,
          "nlsCharsetId":  871,
          "additionalArchivedLogDestId":  5,
          "allowSelectNestedTables":  true,
          "replicateInvisibleColumns":  true
        },
        "override_properties":  {
        }

In our case we are not using ASM, when tested connectivity tests, we are good and Qlik Task can connect to both Oracle as Source & Azure SQL as Target without any issues.

Test 1: For the Same task we have changed the settings from Replicate Log Reader to LogMiner and test the case where it worked well. Log file is attached.

Test 2: Changed Advanced Task Settings to "Replicate Log Reader", tested the connectivity and then tried starting the task. Unfortunately Task is not starting for which both log and snapshot is attached for review.

Appreciate your help here to solve the issue.

Summary:

We have tested Migration & Replication using Log Miner which works well. Our goal is to setup and test the same using Replicate Log Reader option. While trying that we are facing issue as explained.

[pavan_peri]

Hi Hein,

Attached another test log for review along with snapshot where we get error as TCP Error surprisingly, but when tested the connection, it works well and says Connection Successful.

Await your guidance to solve this please.

[SushilKumar]

Hello Team,

Seems you need to raise a case with TSE for further analysis. Share the task Diagnostics package along with case.

As Qlik replicate fetch all the information from the database itself. 

Regards,

Sushil Kumar

[pavan_peri]

Hi Sushil,

We are happy to do this, before we want to raise the case we would like to know why Qlik is unable to connect to Oracle when "Replicate Log Reader" Option is selected? The same task works fine when "LogMiner is selected"

Would like to know what could be the issue and the rest.. hope you have reviewed our logs?

[pavan_peri]

Hi Sushil,

As suggested, i have raised a case. Please refer to the case # 00116167 more more details.

[Heinvandenheuvel]

Thanks for the JSON.  There is this "archivedLogDestId":  5,... "additionalArchivedLogDestId":  5,

I guess that's deliberate? RAC? Leftover?

 I also noticed the  // on the source endpoint connection string that's not very common to be used. I tried ion my own server and it does not seem to make a difference. So no issue.

Maybe there is something odd about the source DB, do you have an other one to connect to , just an Express edition if you have to?

Next time, maybe run with LOGGING SOURCE_CAPTURE VERBOSE to hopefully get relevant details. Kill after first errors.

Finally, but I suppose that has effectively already happened while trying. Start a fresh endpoint and task from scratch, using simple short names. Same thing?

Hein