Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
rohitk1609
Master
Master

How much concurrent tasks should run on scheduler node which has 32 virtual processors ?

Hi team,

We have multi node site in which scheduler node has 208 GB RAM and 32 virtual processors(Hyperthreading is enabled). We had 4 Max concurrent Reloads by default  but we have noticed that CPU was utilised maximum 20%. On other hand RAM was utilised 60 to 70 percent during busiest hours.  

We have increased Max concurrent Reloads to 7. Now we have noticed sometimes CPU spikes to 100% but we assume CPUs are being used fully.

Is there any calculation to setup Max concurrent Reloads w.r.t number of virtual processors?

We are looking for best option to set Max concurrent Reloads.

 

Thanks,

Rohit

Labels (1)
2 Replies
mtamni
Contributor III
Contributor III

Hello Rohit,

 

I am looking for the same information, did you get any answer since ?

 

Best Regards,

Mehdi

korsikov
Partner - Specialist III
Partner - Specialist III

usually "Max. concurrent reload " is set, for example, num_vCPU - 2. For example, 32 vCPU = 30 concurrent reboots. But this is just a theory. In real work, the CPU usage of a single reload depends on how the Qlik load script works, whether it can be multi-threaded. A lot of calculations that can only be performed in one thread.

in your case, it is better to go the practical way, using the task matrix in the Operation monitor application, gradually adding the number of simultaneously executing reloads.