Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik and ServiceNow Partner to Bring Trusted Enterprise Context into AI-Powered Workflows. Learn More!
cancel
Showing results for 
Search instead for 
Did you mean: 
nexusiceland
Contributor
Contributor

Data Replication Latency in Qlik Replicate - Seeking Resolution

I hope this message finds you well. I'm currently facing a challenge with data replication in Qlik Replicate. Despite proper configuration, there is an observable delay in replicating data, impacting the real-time nature of our  Employee Portal data analytics HR services for  nexus smart id https://nexus-iceland.wiki/ . I've thoroughly reviewed network connectivity, replication settings, and logs, yet the issue persists. If anyone in the community has encountered similar challenges with data replication delays in Qlik Replicate or can provide insights into potential solutions, your assistance would be highly valued.

Labels (2)
4 Replies
Aasir
Creator III
Creator III

1. Adjust parameters batch sizes, commit intervals, and parallelism to optimize replication performance.

2. Ensure that CDC is configured correctly

Bill_Steinagle
Support
Support

@nexusiceland 

Thank you for the post to the QDI Forums. As per the Community Links already shared the first step is to confirm is this is a Source or Target Latency issue with the Task. Along with the articles posted you can enable the Loggers noted below using the Monitor Tab in Replicate Console under Tools Log Management to enable these loggers. Using the monitor Tab this is done dynamically so the Task does not have to be stopped or resumed. 

Set the loggers to Trace allowing the Task to run for an hour and check the Log file for the following keywords to help understand the performance issue with the Task Latency. 

Loggers below set to TRACE

PERFORMANCE

TARGET_APPLY

The Log file will show the logger example PERFORMANCE and the Latency if either on Source and or Target with the Handling of the Latency between the Source and Target Endpoints. Along with the output you can check the TARGET_APPLY keyword in the Log file for bulk_apply keyword which will given you the time its taken to apply to the Target if its Target related Latency issue if the Task is setup to be Batch Optimized in the Change Processing Tuning section of the Task under Change Processing Mode.

And finally if you have any performance related issues with Replicate you can always inquire to have our Professional Services Team engaged to have a dedicated source to work with you on the Performance related issues with any Task as a paid engagement with Qlik. 

Hope this helps and thank you for the post.

Thanks,

Bill

SushilKumar
Support
Support

Hello Team,

For latency related issue and to understand the cause of it requires LOG and through analysis of logs. We would request you to raise a Support case and engage TSE for further investigation.

Regards,

Sushil Kumar