Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I hope this message finds you well. I'm currently facing a challenge with data replication in Qlik Replicate. Despite proper configuration, there is an observable delay in replicating data, impacting the real-time nature of our Employee Portal data analytics HR services for nexus smart id https://nexus-iceland.wiki/ . I've thoroughly reviewed network connectivity, replication settings, and logs, yet the issue persists. If anyone in the community has encountered similar challenges with data replication delays in Qlik Replicate or can provide insights into potential solutions, your assistance would be highly valued.
1. Adjust parameters batch sizes, commit intervals, and parallelism to optimize replication performance.
2. Ensure that CDC is configured correctly
Hello @nexusiceland ,
Thank you for reaching out to the Qlik community!
Please find the below articles which will help you to understand more about latency and fine tuning of the tasks.
Hope these helps you.
https://community.qlik.com/t5/Knowledge/Improving-performance-on-Replicate-Target-Apply/ta-p/1906500
Regards,
Sachin B
Thank you for the post to the QDI Forums. As per the Community Links already shared the first step is to confirm is this is a Source or Target Latency issue with the Task. Along with the articles posted you can enable the Loggers noted below using the Monitor Tab in Replicate Console under Tools Log Management to enable these loggers. Using the monitor Tab this is done dynamically so the Task does not have to be stopped or resumed.
Set the loggers to Trace allowing the Task to run for an hour and check the Log file for the following keywords to help understand the performance issue with the Task Latency.
Loggers below set to TRACE
PERFORMANCE
TARGET_APPLY
The Log file will show the logger example PERFORMANCE and the Latency if either on Source and or Target with the Handling of the Latency between the Source and Target Endpoints. Along with the output you can check the TARGET_APPLY keyword in the Log file for bulk_apply keyword which will given you the time its taken to apply to the Target if its Target related Latency issue if the Task is setup to be Batch Optimized in the Change Processing Tuning section of the Task under Change Processing Mode.
And finally if you have any performance related issues with Replicate you can always inquire to have our Professional Services Team engaged to have a dedicated source to work with you on the Performance related issues with any Task as a paid engagement with Qlik.
Hope this helps and thank you for the post.
Thanks,
Bill
Hello Team,
For latency related issue and to understand the cause of it requires LOG and through analysis of logs. We would request you to raise a Support case and engage TSE for further investigation.
Regards,
Sushil Kumar