topic Re: BW Data source replication in Qlik Replicate

BW Data source replication

msdra72 — Tue, 08 Oct 2024 18:36:42 GMT

Hello Everyone,

We were trying to replicate data from the server. In Quality, the SAP job that the QLIK application prompted to execute still never completes. It's just overlapping because each time there is a connectivity issue between the QLIK and SAP application, a new job is started. Even though the jobs are still live on the SAP side, it is no longer updating on the QLIK side. The error message, "Connection reset by peer," is still present. Here are the logs that we have seen from the QLIK side.

00010196: 2024-10-08T12:01:22 [TARGET_LOAD ]I: Working with BCPKeepNull set to TRUE (sqlserver_endpoint_imp.c:1822)
00010196: 2024-10-08T12:01:22 [TARGET_LOAD ]I: Target endpoint 'SQL Server Azure' is using provider syntax 'SQLAzure' (provider_syntax_manager.c:979)
00010196: 2024-10-08T12:01:22 [TARGET_LOAD ]I: Going to use provider syntax for datatype mapping (sqlserver_endpoint_imp.c:1849)
00010196: 2024-10-08T12:01:22 [TARGET_LOAD ]I: Going to connect to server 'pazsql003.database.windows.net' database 'QDI' (sqlserver_endpoint_imp.c:1853)
00010196: 2024-10-08T12:01:23 [TARGET_LOAD ]I: Target endpoint 'SQL Server Azure' is using provider syntax 'SQLAzure' (provider_syntax_manager.c:979)
00009116: 2024-10-08T12:01:24 [TABLES_MANAGER ]I: The 'Custom' source endpoint does not support segmented full load. The table ''.'ZFI_GL_14 - New FI GL Accounting Extractor' will be loaded normally (tasktablesmanager.c:1048)
00009116: 2024-10-08T12:01:24 [TASK_MANAGER ]I: Start loading table ''.'ZFI_GL_14 - New FI GL Accounting Extractor' (Id = 1) by subtask 1. Start load timestamp 000623F93FC60340 (replicationtask_util.c:761)
00017824: 2024-10-08T12:01:24 [TRANSFORMATION ]I: A filter is defined for column(s) 'BUDAT,BUKRS,RLDNR,RYEAR' in table '.ZFI_GL_14 - New FI GL Accounting Extractor' (manipulator.c:1777)
00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: An error occurred unloading dataset: .ZFI_GL_14 - New FI GL Accounting Extractor
java.lang.RuntimeException: Communication error, see dev_jco_rfc.log for more information
at com.qlik.sap.endpoints.odp.SapOdpSourceEndpointActual.unloadDataset(SapOdpSourceEndpointActual.java:526)
at com.qlik.sap.endpoints.odp.SapOdpSourceEndpoint.unloadDataset(SapOdpSourceEndpoint.java:54)
at com.attunity.replicate.rependsrv.sdk.internal.CustomEndpointSDK$2.write(CustomEndpointSDK.java:328)
at org.glassfish.jersey.message.internal.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:55)
at org.glassfish.jersey.message.internal.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:37)
at org.glassfish.jersey.message.internal.WriterInterceptorExecutor$TerminalWriterInterceptor.invokeWriteTo(WriterInterceptorExecutor.java:242)
at org.glassfish.jersey.message.internal.WriterInterceptorExecutor$TerminalWriterInterceptor.aroundWriteTo(WriterInterceptorExecutor.java:227)
at org.glassfish.jersey.message.internal.WriterInterceptorExecutor.proceed(WriterInterceptorExecutor.java:139)
at org.glassfish.jersey.server.internal.JsonWithPaddingInterceptor.aroundWriteTo(JsonWithPaddingInterceptor.java:85)
at org.glassfish.jersey.message.internal.WriterInterceptorExecutor.proceed(WriterInterceptorExecutor.java:139)
at org.glassfish.jersey.server.internal.MappableExceptionWrapperInterceptor.aroundWriteTo(MappableExceptionWrapperInterceptor.java:61)
at org.glassfish.jersey.message.internal.WriterInterceptorExecutor.proceed(WriterInterceptorExecutor.java:139)
at org.glassfish.jersey.message.internal.MessageBodyFactory.writeTo(MessageBodyFactory.java:1116)
at org.glassfish.jersey.server.ServerRuntime$Responder.writeResponse(ServerRuntime.java:677)
at org.glassfish.jersey.server.ServerRuntime$Responder.processResponse(ServerRuntime.java:385)
at org.glassfish.jersey.server.ServerRuntime$Responder.process(ServerRuntime.java:375)
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:264)
at (custom_endpoint_util.c:1155)
00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: Communication error, see dev_jco_rfc.log for more information [1024719] (custom_endpoint_unload.c:258)
00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: Failed during unload [1024719] (custom_endpoint_unload.c:442)
00009116: 2024-10-08T12:32:33 [TASK_MANAGER ]I: Task error notification received from subtask 1, thread 0, status 1024719 (replicationtask.c:3628)
00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: Error executing source loop [1024719] (streamcomponent.c:1945)
00017824: 2024-10-08T12:32:33 [TASK_MANAGER ]E: Stream component failed at subtask 1, component st_1_ECC QS4 [1024719] (subtask.c:1474)
00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: Stream component 'st_1_ECC QA' terminated [1024719] (subtask.c:1643)
00009116: 2024-10-08T12:32:34 [TASK_MANAGER ]I: Subtask #1 ended (replicationtask_util.c:591)
00009116: 2024-10-08T12:32:34 [TASK_MANAGER ]I: Reloading table 1 because subtask #1 finished with error (replicationtask.c:2767)
00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Bulk is set to ignore max row size warnings (sqlserver_endpoint_imp.c:1758)
00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Working with collated columns (sqlserver_endpoint_imp.c:1818)
00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Working with BCPKeepNull set to TRUE (sqlserver_endpoint_imp.c:1822)
00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Target endpoint 'SQL Server Azure' is using provider syntax 'SQLAzure' (provider_syntax_manager.c:979)
00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Going to use provider syntax for datatype mapping (sqlserver_endpoint_imp.c:1849)
00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Going to connect to server 'pazsql003.database.windows.net' database 'QDI' (sqlserver_endpoint_imp.c:1853)
00018384: 2024-10-08T12:32:35 [TARGET_LOAD ]I: Target endpoint 'SQL Server Azure' is using provider syntax 'SQLAzure' (provider_syntax_manager.c:979)
00009116: 2024-10-08T12:32:36 [TASK_MANAGER ]I: Start loading table ''.'ZFI_GL_14 - New FI GL Accounting Extractor' (Id = 1) by subtask 1. Start load timestamp 000623F9AF622ADF (replicationtask_util.c:761)

Network side confirmed that there were no issues found and concurrent usage has also increased.

10.67.3.149 - Qlik IP

160.222.250.74 - QA IP

Checked on the SAP Side and the issues that we can only see is this:

Tue Oct 8 04:42:17:467 2024
***LOG Q0I=> NiIRead: P=10.67.3.149:53692; L=160.222.250.74:3339: recv (104: Connection reset by peer) [/bas/753_REL/src/base/ni/nixxi.cpp 5429]
*** ERROR => NiIRead: SiRecv failed for hdl 184/sock 99
(SI_ECONN_BROKEN/104; I4; ST; P=10.67.3.149:53692; L=160.222.250.74:3339) [nixxi.cpp 5429]
***LOG S23=> GwDisconnectClient, client disconnected (1509) [gwxxrd.c 11546]
GwDisconnectClient: client 1509 disconnected, hostname = pmanappd, addr = 10.67.3.149, tp = java

*****************************************************************************
*
* LOCATION SAP-Gateway on host QA / sapgw39
* ERROR connection to partner '10.67.3.149:53692' broken
*
* TIME Tue Oct 8 04:42:17 2024
* RELEASE 753
* COMPONENT NI (network interface)
* VERSION 40
* RC -6
* MODULE /bas/753_REL/src/base/ni/nixxi.cpp
* LINE 5429
* DETAIL NiIRead: P=10.67.3.149:53692; L=160.222.250.74:3339
* SYSTEM CALL recv
* ERRNO 104
* ERRNO TEXT Connection reset by peer
* COUNTER 739925

Thank you.

Re: BW Data source replication

john_wang — Wed, 09 Oct 2024 06:23:27 GMT

Hello @msdra72 ,

Welcome to Qlik Community forum and thanks for reaching out here!

It's hard to tell from the error message only this time. Please open a support ticket with below information:

1. Set SOURCE_UNLOAD to Verbose, recreate the issue then download the Diagnostics Package

2. Helpful information from SAP side.

Our support team will be more than happy to assist you.

Regards,

John.

Re: BW Data source replication

Anonymous — Wed, 09 Oct 2024 10:09:57 GMT

Hello @msdra72 , I always agree that logs are the best way to debug an issue so I agree with the support that maybe more logs might be useful.

By reviewing the logs you posted, I notices the following errors:

- From a QLIK perspective: java.lang.RuntimeException: Communication error, see dev_jco_rfc.log for more information

Communication error is very generic, but:

- task started at: 00010196: 2024-10-08T12:01:22

- error thrown at: 00017824: 2024-10-08T12:32:33

Almost 30 mins after.

- From a remote endpoint perspective: Connection reset by peer

Do you have the log at the same time of QLIK?

Anyway:

How packets between those endpoints are routed? I see a private IP and a Public IP in the communication: this is rare but possible in some kind of private circuits (VPN).

(SI_ECONN_BROKEN/104; I4; ST; P=10.67.3.149:53692; L=160.222.250.74:3339) [nixxi.cpp 5429]

Is rare, but I can try to guess the following is happening here:

QLIK sends a SYN packet to public IP which is routed until the destination NIC, but from the other side (SAP network) someone is dropping the connection (SAP response SYN/ACK). QLIK goes in timeout and SAP in Connection Reset.

I think a network dump of both hosts and the SAP log at the same time from QLINK will be helpful.

I will be out for a couple of days but please let me know because I'm interested in this topic.

Thanks!

Re: BW Data source replication

msdra72 — Wed, 09 Oct 2024 14:18:42 GMT

Hello,

I have requested for the dev_jco_rfc.log and this is what its pointing to:

Error: >Tue Oct 08 12:32:13,759< >RfcGetException (rc=3) message: CPIC-CALL: CMRCV on convId: 23974808

ERROR connection to partner 'arpa0qs4.apack.biz:3339' broken

TIME Tue Oct 08 12:32:13 2024

RELEASE 753

COMPONENT NI (network interface)

VERSION 40

RC -6

MODULE D:/depot/bas/753_REL/src/base/ni/nixxi.cpp

LINE 5429

DETAIL NiIRead: P=160.222.250.74:3339; L=10.67.3.149:60066

SYSTEM CALL recv

ERRNO 10054

ERRNO TEXT WSAECONNRESET: Connection reset by peer

COUNTER 3

<RfcGetException

Error: [9] >Tue Oct 08 12:32:13,759< RfcException raised by system [QS4|arpa0qs4|39]:

message: CPIC-CALL: CMRCV on convId: 23974808

ERROR connection to partner 'arpa0qs4.apack.biz:3339' broken

TIME Tue Oct 08 12:32:13 2024

RELEASE 753

COMPONENT NI (network interface)

VERSION 40

RC -6

MODULE D:/depot/bas/753_REL/src/base/ni/nixxi.cpp

LINE 5429

DETAIL NiIRead: P=160.222.250.74:3339; L=10.67.3.149:60066

SYSTEM CALL recv

ERRNO 10054

ERRNO TEXT WSAECONNRESET: Connection reset by peer

COUNTER 3

return code: RFC_SYS_EXCEPTION (3)

error group: 102

key: RFC_ERROR_COMMUNICATION

I can also attach the rependsrv logs and reptasks log. Please see the attached. Thank you