Maximum number of Replicate tasks on a scalable cloud VM

[NakulanR]

Hi Support,

In previous community articles a limit of 100 tasks per Replicate server is mentioned, as per a Windows limitation. Just wondering if that 100 task limit still stands if Replicate is running on a VM hosted in the cloud, with the VM itself being able to be scaled up to allow for more compute resources, e.g. an Azure VM with 48vCPUs and 192 GB of RAM.

For context, the Replicate architecture is a single Log Stream staging task reading changes from the source database, and there are currently ~80 downstream tasks writing to different hubs/partitions in Event Hubs.

Articles for reference:

• https://community.qlik.com/t5/Qlik-Replicate/Qlik-Replicate-number-of-tasks-and-table-limitation-per...
• https://community.qlik.com/t5/Qlik-Replicate/Attunity-Replicate-best-practices/td-p/1798657

Thanks,

Nak

[sureshkumar · Accepted solution]

Hello @NakulanR 

Whether the Replicate Sever in VM or VM hosted in Cloud, as mentioned in the user guide

"Bearing this in mind, the number of tasks that can be run on a single Replicate Server should not exceed 100 (and may need to be significantly less depending on the aforementioned variables). Best practice is to perform load testing in a Test environment before moving to Production."

You can test it in your environment.

Defining and managing tasks | Qlik Enterprise Manager Help

There is No restrictions in replicate code but some external OS level parameters can effect active task numbers, core and memory are very important, Task tables, data volume etc are factor also that's why As a rule of thumb R&D recommends up to 100 concurrently executing tasks per Replicate Server machine.

Regards,

Suresh