topic Re: Data Replication Latency in Qlik Replicate - Seeking Resolution in Qlik Replicate

Data Replication Latency in Qlik Replicate - Seeking Resolution

nexusiceland — Sat, 18 Nov 2023 09:36:31 GMT

I hope this message finds you well. I'm currently facing a challenge with data replication in Qlik Replicate. Despite proper configuration, there is an observable delay in replicating data, impacting the real-time nature of our Employee Portal data analytics HR services for nexus smart id https://nexus-iceland.wiki/ . I've thoroughly reviewed network connectivity, replication settings, and logs, yet the issue persists. If anyone in the community has encountered similar challenges with data replication delays in Qlik Replicate or can provide insights into potential solutions, your assistance would be highly valued.

Re: Data Replication Latency in Qlik Replicate - Seeking Resolution

Aasir — Wed, 15 Nov 2023 06:44:40 GMT

1. Adjust parameters batch sizes, commit intervals, and parallelism to optimize replication performance.

2. Ensure that CDC is configured correctly

Re: Data Replication Latency in Qlik Replicate - Seeking Resolution

SachinB — Wed, 15 Nov 2023 06:57:28 GMT

Hello @nexusiceland ,

Thank you for reaching out to the Qlik community!

Please find the below articles which will help you to understand more about latency and fine tuning of the tasks.

Hope these helps you.

https://community.qlik.com/t5/Knowledge/Latency-Performance-Troubleshooting-and-Tuning-for-Replicate/ta-p/1734097

https://community.qlik.com/t5/Knowledge/Troubleshooting-Qlik-Replicate-Latency-and-Performance-Issues/ta-p/1929456

https://community.qlik.com/t5/Knowledge/Latency-Performance-Troubleshooting-and-Tuning-for-Replicate/ta-p/1734097

https://community.qlik.com/t5/Knowledge/Improving-performance-on-Replicate-Target-Apply/ta-p/1906500

Regards,

Sachin B

Re: Data Replication Latency in Qlik Replicate - Seeking Resolution

Bill_Steinagle — Wed, 15 Nov 2023 13:33:06 GMT

@nexusiceland

Thank you for the post to the QDI Forums. As per the Community Links already shared the first step is to confirm is this is a Source or Target Latency issue with the Task. Along with the articles posted you can enable the Loggers noted below using the Monitor Tab in Replicate Console under Tools Log Management to enable these loggers. Using the monitor Tab this is done dynamically so the Task does not have to be stopped or resumed.

Set the loggers to Trace allowing the Task to run for an hour and check the Log file for the following keywords to help understand the performance issue with the Task Latency.

Loggers below set to TRACE

PERFORMANCE

TARGET_APPLY

The Log file will show the logger example PERFORMANCE and the Latency if either on Source and or Target with the Handling of the Latency between the Source and Target Endpoints. Along with the output you can check the TARGET_APPLY keyword in the Log file for bulk_apply keyword which will given you the time its taken to apply to the Target if its Target related Latency issue if the Task is setup to be Batch Optimized in the Change Processing Tuning section of the Task under Change Processing Mode.

And finally if you have any performance related issues with Replicate you can always inquire to have our Professional Services Team engaged to have a dedicated source to work with you on the Performance related issues with any Task as a paid engagement with Qlik.

Hope this helps and thank you for the post.

Thanks,

Bill

Re: Data Replication Latency in Qlik Replicate - Seeking Resolution

SushilKumar — Thu, 16 Nov 2023 00:56:32 GMT

Hello Team,

For latency related issue and to understand the cause of it requires LOG and through analysis of logs. We would request you to raise a Support case and engage TSE for further investigation.

Regards,

Sushil Kumar