topic Re: TASKS IN QMC NOT RUNNING in QlikView

TASKS IN QMC NOT RUNNING

kakani87 — Wed, 02 May 2018 11:54:22 GMT

Dear Folks ...

Tasks in QMC they are not running. which we use to generate pdf.

when manually run them they are not in progress to generate PDF

There are multiple tasks got scheduled on the same document.

Configured some sample tasks on another document to check with the status of running and they are in progress.

Now the existing task started and taking long time to execute with the sample tasks.

When i tried killing/stop the tasks they are not getting stopped .

NOTE: Restarted the services as well

Any help is appreciable.

Re: TASKS IN QMC NOT RUNNING

Miguel_Angel_Baeyens — Wed, 02 May 2018 12:01:09 GMT

Enable the script logs in the document settings > General > generate logfile, run one of the tasks and see where it fails (e.g.: a path to a file is not working, lack of permissions, etc.)

Then check the status in the QMC for such task and post here whatever the result is to further troubleshoot.

Re: TASKS IN QMC NOT RUNNING

kakani87 — Wed, 02 May 2018 12:15:38 GMT

Hi Miguel ... thank you for responding

Here I'm sharing the log file for reference.

Earlier it was successfully generating the pdfs.

Re: TASKS IN QMC NOT RUNNING

olivierrobin — Wed, 02 May 2018 14:36:50 GMT

hello

I would check the max. time allowed for a task to run

Re: TASKS IN QMC NOT RUNNING

Miguel_Angel_Baeyens — Wed, 02 May 2018 15:38:09 GMT

This log is incomplete. It would be much useful if you can you share the one from the QVW that you can enable as I specified above?

Re: TASKS IN QMC NOT RUNNING

kakani87 — Thu, 03 May 2018 04:30:40 GMT

As discussed I'm sharing the log file suggested by you.

Actually tasks got executed and generated pdfs

I have noticed the cpu usage is showing like 100% and keep on fluctuating yesterday when i post this issue.

How to reduce the cpu usage when the usage is high.

<?xml version="1.0" encoding="utf-8"?>

<Root>

</Root>

Re: TASKS IN QMC NOT RUNNING

Miguel_Angel_Baeyens — Thu, 03 May 2018 07:05:42 GMT

In QlikView 12 for the sake of performance, resources in the distribution service server are used at its max, so expect high CPU usage (over RAM usage) if you are using this version of QlikView.

As far as I'm aware, this is expected and normal. What you can do is limit the threshold above which no more tasks will be run (if they are triggered they will be queued until the previous tasks have been completed).

If the tasks complete, perhaps they simply don't show up in the QMC?

As for the logs, in case needed, the ones generated along the QVW file (in the same folder) that you need to set up as mentioned above. The script logs, to see whether the script is taking longer on certain task like a join, a load or a store. Those logs.

EDIT: threshold settings for QDS in QV12

Queued jobs

Re: TASKS IN QMC NOT RUNNING

kakani87 — Thu, 03 May 2018 12:47:57 GMT

But Currently I'm working with QVS 11.20

Thanks alot for spending your valuable time.

Re: TASKS IN QMC NOT RUNNING

Miguel_Angel_Baeyens — Thu, 03 May 2018 13:24:28 GMT

In QV 11.20 you can set CPUAffinity, so how many CPUs should be working maximum at any point in time. I would recommend to set 1 or 2 to 0, in this case you should never see 100% utilization, if only the QlikView Distribution Service is running.

This setting is in the QVPR folder (by default C:\ProgramData\QlikTech\ManagementService\) in the file DistributionService.xml

The value is a string of 1 (to be used) or 0 (to not be used) for each core Windows can see (as in the Windows Task Manager). If your server has 16 cores and you want to leave 2 free, the line would look like something like this:

<DistributionService XSWebAdress="http://hostname:4720/QDS/Service" DSCID="<sid>" LogLevel="Normal" IsPublisher="true" MaxSimultaneousQvb="4" MaxSimultaneousReaderQVBs="20" IsCluster="false" SectionAccessUserName="" SectionAccessPassword="" CPUAffinity="1111111111111100" CPUPriority="Low" ApplicationDataFolder="C:\ProgramData\QlikTech\DistributionService" Username="" Password="" DisableTaskTriggersForDocAdmins="false" ShowAlerts="true" ClusterName="" ModifiedByUser="DIR\USER" ModifiedTime="<timestamp>" ID="<id>" />

Re: TASKS IN QMC NOT RUNNING

kakani87 — Tue, 08 May 2018 07:40:26 GMT

Able to see QVDistributionService.exe.config in Distribution Services folder

As mentioned in the above DistributionService.xml no such kind of file available in Management Services folder

The server Config I'm handling will be like

CPU 4 cores with 64 gb memory

Re: TASKS IN QMC NOT RUNNING

Miguel_Angel_Baeyens — Tue, 08 May 2018 08:33:31 GMT

The ManagementService file will be stored in the computer where the QMS is running, not the QDS.

Re: TASKS IN QMC NOT RUNNING

kakani87 — Tue, 08 May 2018 10:02:06 GMT

As i posted earlier that I'm working on server with CPU 4 Cores and 64 GB Memory

Here it is mentioned as CUPAffinity = "1111" in DistributionService.xml file

Now if i enhance this config to CUPAffinity = "1110"

will this free one cpu core to restrict the 100% usage

Re: TASKS IN QMC NOT RUNNING

Miguel_Angel_Baeyens — Tue, 08 May 2018 11:34:58 GMT

1110 will tell QlikView to use as much as 3 CPUs, but be aware that the other CPU will be busy with OS stuff, antivirus, etc.

Also bear in mind that this setting disappears in QlikView 12, there is no way to set up CPU affinity for the Distribution Service

Re: TASKS IN QMC NOT RUNNING

kakani87 — Tue, 08 May 2018 12:28:28 GMT

As I'm having poor Admin knowledge i would like to know

whether this CpuAffinity config is recomended for cpu with 4 core.

Re: TASKS IN QMC NOT RUNNING

Miguel_Angel_Baeyens — Tue, 08 May 2018 14:16:40 GMT

According to Qlik's best practices and as a rule of thumb: the more resources, the better, and that's why the removed this setting in QlikView 12. So using all CPUs should be fine even if they are at 100% for some time.

There are some actions, like saving a file or doing a JOIN which requires more CPU than usual, so it's completely normal to see the CPU usage spiking to 100% for a few seconds, then down to 20% (or even less) and then up again to 80%-90%. This is perfectly fine.

Factors that affect this usage are file size (saving files of several GBs takes a lot of resources), complexity of the script (aggregations, functions used, JOINs), size of the tables (dozens of columns with very distinct values), etc.

If for any reason this usage makes the system unstable, there are usually two reasons

The script/data model/files are too big and they should be reduced or the environment needs more resources (e.g.: natural growth in complexity, or distribution service in the same computer than QlikView Server and increase in the number of users)
There are other processes in Windows competing for those resources (antivirus mostly, but could also be a backup or snapshot software)

If none of those two are the case, then report to Qlik Support so they can investigate further.

Re: TASKS IN QMC NOT RUNNING

jltsupport — Wed, 24 Jul 2019 07:41:43 GMT

Hello Miguel, I'm using QV12 and tasks are getting queued, how can I change the threshold in QDS by changing number of simultaneous jobs?