Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello Everyone,
We are using Qlik Replicate 2024.11.
Currently, the data transfer volume of a staging task using the Replicate Log Reader is causing network bandwidth congestion.
In this environment, could you please advise if there is a way to reduce or compress the transferred data?
We would like to achieve this without changing the current system architecture, only by modifying the Qlik Replicate settings.
Hello @iti-attunity-sup ,
In addition to @DesmondWOO comments - yes, enabling compression can help reduce the volume of network data transferred. However, the actual benefit depends on whether the database client and server support compression via the ODBC driver.
For example, in MySQL, this is supported through options like COMPRESSED_PROTO=1. In my pressure tests, ~40% data size was reduced.
Hope this helps.
John.
Hi @iti-attunity-sup ,
I haven’t received any reports of network congestion from customers.
Could you confirm the available network bandwidth in the customer’s environment?
Additionally, could you provide a specific figure indicating how much bandwidth the staging task is currently utilizing.
Thanks,
Desmond
Hello @iti-attunity-sup ,
In addition to @DesmondWOO comments - yes, enabling compression can help reduce the volume of network data transferred. However, the actual benefit depends on whether the database client and server support compression via the ODBC driver.
For example, in MySQL, this is supported through options like COMPRESSED_PROTO=1. In my pressure tests, ~40% data size was reduced.
Hope this helps.
John.
Hello @DesmondWOO and @john_wang,
Thank you for your response.
My question was intended to confirm whether it is generally possible to reduce or compress data transfer through Qlik Replicate settings, regardless of the customer's specific environment.
Based on your answer, I understand that data compression needs to be handled outside of Qlik Replicate.
Thank you again for your support.
Thank you for your support! @iti-attunity-sup
Best Regards,
Desmond & John.