We were trying to replicate data from the server. In Quality, the SAP job that the QLIK application prompted to execute still never completes. It's just overlapping because each time there is a connectivity issue between the QLIK and SAP application, a new job is started. Even though the jobs are still live on the SAP side, it is no longer updating on the QLIK side. The error message, "Connection reset by peer," is still present. Here are the logs that we have seen from the QLIK side.
00010196: 2024-10-08T12:01:22 [TARGET_LOAD ]I: Working with BCPKeepNull set to TRUE (sqlserver_endpoint_imp.c:1822) 00010196: 2024-10-08T12:01:22 [TARGET_LOAD ]I: Target endpoint 'SQL Server Azure' is using provider syntax 'SQLAzure' (provider_syntax_manager.c:979) 00010196: 2024-10-08T12:01:22 [TARGET_LOAD ]I: Going to use provider syntax for datatype mapping (sqlserver_endpoint_imp.c:1849) 00010196: 2024-10-08T12:01:22 [TARGET_LOAD ]I: Going to connect to server 'pazsql003.database.windows.net' database 'QDI' (sqlserver_endpoint_imp.c:1853) 00010196: 2024-10-08T12:01:23 [TARGET_LOAD ]I: Target endpoint 'SQL Server Azure' is using provider syntax 'SQLAzure' (provider_syntax_manager.c:979) 00009116: 2024-10-08T12:01:24 [TABLES_MANAGER ]I: The 'Custom' source endpoint does not support segmented full load. The table ''.'ZFI_GL_14 - New FI GL Accounting Extractor' will be loaded normally (tasktablesmanager.c:1048) 00009116: 2024-10-08T12:01:24 [TASK_MANAGER ]I: Start loading table ''.'ZFI_GL_14 - New FI GL Accounting Extractor' (Id = 1) by subtask 1. Start load timestamp 000623F93FC60340 (replicationtask_util.c:761) 00017824: 2024-10-08T12:01:24 [TRANSFORMATION ]I: A filter is defined for column(s) 'BUDAT,BUKRS,RLDNR,RYEAR' in table '.ZFI_GL_14 - New FI GL Accounting Extractor' (manipulator.c:1777) 00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: An error occurred unloading dataset: .ZFI_GL_14 - New FI GL Accounting Extractor java.lang.RuntimeException: Communication error, see dev_jco_rfc.log for more information at com.qlik.sap.endpoints.odp.SapOdpSourceEndpointActual.unloadDataset(SapOdpSourceEndpointActual.java:526) at com.qlik.sap.endpoints.odp.SapOdpSourceEndpoint.unloadDataset(SapOdpSourceEndpoint.java:54) at com.attunity.replicate.rependsrv.sdk.internal.CustomEndpointSDK$2.write(CustomEndpointSDK.java:328) at org.glassfish.jersey.message.internal.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:55) at org.glassfish.jersey.message.internal.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:37) at org.glassfish.jersey.message.internal.WriterInterceptorExecutor$TerminalWriterInterceptor.invokeWriteTo(WriterInterceptorExecutor.java:242) at org.glassfish.jersey.message.internal.WriterInterceptorExecutor$TerminalWriterInterceptor.aroundWriteTo(WriterInterceptorExecutor.java:227) at org.glassfish.jersey.message.internal.WriterInterceptorExecutor.proceed(WriterInterceptorExecutor.java:139) at org.glassfish.jersey.server.internal.JsonWithPaddingInterceptor.aroundWriteTo(JsonWithPaddingInterceptor.java:85) at org.glassfish.jersey.message.internal.WriterInterceptorExecutor.proceed(WriterInterceptorExecutor.java:139) at org.glassfish.jersey.server.internal.MappableExceptionWrapperInterceptor.aroundWriteTo(MappableExceptionWrapperInterceptor.java:61) at org.glassfish.jersey.message.internal.WriterInterceptorExecutor.proceed(WriterInterceptorExecutor.java:139) at org.glassfish.jersey.message.internal.MessageBodyFactory.writeTo(MessageBodyFactory.java:1116) at org.glassfish.jersey.server.ServerRuntime$Responder.writeResponse(ServerRuntime.java:677) at org.glassfish.jersey.server.ServerRuntime$Responder.processResponse(ServerRuntime.java:385) at org.glassfish.jersey.server.ServerRuntime$Responder.process(ServerRuntime.java:375) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:264) at (custom_endpoint_util.c:1155) 00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: Communication error, see dev_jco_rfc.log for more information [1024719] (custom_endpoint_unload.c:258) 00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: Failed during unload [1024719] (custom_endpoint_unload.c:442) 00009116: 2024-10-08T12:32:33 [TASK_MANAGER ]I: Task error notification received from subtask 1, thread 0, status 1024719 (replicationtask.c:3628) 00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: Error executing source loop [1024719] (streamcomponent.c:1945) 00017824: 2024-10-08T12:32:33 [TASK_MANAGER ]E: Stream component failed at subtask 1, component st_1_ECC QS4 [1024719] (subtask.c:1474) 00017824: 2024-10-08T12:32:33 [SOURCE_UNLOAD ]E: Stream component 'st_1_ECC QA' terminated [1024719] (subtask.c:1643) 00009116: 2024-10-08T12:32:34 [TASK_MANAGER ]I: Subtask #1 ended (replicationtask_util.c:591) 00009116: 2024-10-08T12:32:34 [TASK_MANAGER ]I: Reloading table 1 because subtask #1 finished with error (replicationtask.c:2767) 00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Bulk is set to ignore max row size warnings (sqlserver_endpoint_imp.c:1758) 00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Working with collated columns (sqlserver_endpoint_imp.c:1818) 00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Working with BCPKeepNull set to TRUE (sqlserver_endpoint_imp.c:1822) 00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Target endpoint 'SQL Server Azure' is using provider syntax 'SQLAzure' (provider_syntax_manager.c:979) 00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Going to use provider syntax for datatype mapping (sqlserver_endpoint_imp.c:1849) 00018384: 2024-10-08T12:32:34 [TARGET_LOAD ]I: Going to connect to server 'pazsql003.database.windows.net' database 'QDI' (sqlserver_endpoint_imp.c:1853) 00018384: 2024-10-08T12:32:35 [TARGET_LOAD ]I: Target endpoint 'SQL Server Azure' is using provider syntax 'SQLAzure' (provider_syntax_manager.c:979) 00009116: 2024-10-08T12:32:36 [TASK_MANAGER ]I: Start loading table ''.'ZFI_GL_14 - New FI GL Accounting Extractor' (Id = 1) by subtask 1. Start load timestamp 000623F9AF622ADF (replicationtask_util.c:761)
Network side confirmed that there were no issues found and concurrent usage has also increased.
10.67.3.149 - Qlik IP
160.222.250.74 - QA IP
Checked on the SAP Side and the issues that we can only see is this:
Hello @msdra72 , I always agree that logs are the best way to debug an issue so I agree with the support that maybe more logs might be useful.
By reviewing the logs you posted, I notices the following errors:
- From a QLIK perspective: java.lang.RuntimeException: Communication error, see dev_jco_rfc.log for more information
Communication error is very generic, but:
- task started at: 00010196: 2024-10-08T12:01:22
- error thrown at: 00017824: 2024-10-08T12:32:33
Almost 30 mins after.
- From a remote endpoint perspective: Connection reset by peer
Do you have the log at the same time of QLIK?
Anyway:
How packets between those endpoints are routed? I see a private IP and a Public IP in the communication: this is rare but possible in some kind of private circuits (VPN).
Is rare, but I can try to guess the following is happening here:
QLIK sends a SYN packet to public IP which is routed until the destination NIC, but from the other side (SAP network) someone is dropping the connection (SAP response SYN/ACK). QLIK goes in timeout and SAP in Connection Reset.
I think a network dump of both hosts and the SAP log at the same time from QLINK will be helpful.
I will be out for a couple of days but please let me know because I'm interested in this topic.
