Memory Utilization limit for QDS service?

[sanchayan]

Hi everyone,

In one of our environments we are noticing that even when a single task is getting reloaded on one node its consuming large amount of memory as well as CPU resource. The QDS nodes have 256GB RAM and 20 cores. Thus whenever 4-5 tasks are assigned to reload one the same node, some of them are failing. The max. number of QVBs for distribution though is set as 6 for this environment.

So what I need to know is that :

1. What can be the issue behind it?

2. Is there any way by which we can limit the amount of memory or CPU resource that can be allocated for QDS service? Like we have CPU Throttle and Working Set Limits for QVS service.

Thanks & Regards,

Sanchayan Bhowmik

[tresesco]

1. What can be the issue behind it?

There could be many possible reasons; the data size itself could be huge; the data model could be not that efficient (like, synthetic key, improper joins...); improper loop in the script...

2. Is there any way ...

Perhaps not. QDS seems to be a rather static in nature. Please refer :Re: Publisher memory usage.

[sanchayan]

Hi Tresesco,

I seem to have seen in a qlik community discussion where some guy suggested some setting that's required to be enabled in the QDS.exe.config file to limit the memory usage by QDS. But, not able to recollect that setting now.

Also, is it like that QDS will utilize entire physical memory for data loads when required and then reside to paging?

Thanks,

Sanchayan