QlikView QMC Reloads failing if we run two jobs simultneously

[GD1239]

Hi

When i try to reload QlikView tasks in QMC one by one the reloads are getting succeed but if i run two tasks at time, concurrently then one of the tasks is failing.

In short, tasks are running successfully one by one but one of them is failing when the two tasks are triggered at the same time.

This is not specific to only few apps but for all.

 

[marcus_sommer]

In general you could use multiple parallel tasks - it depends on the number of cores and various settings how many could run in parallel, the others would be queued and also which timeouts are set.

But if those tasks accessing the same resources at the same time - they could block each other mostly because the OS or the DB denied the access. This means you need to ensure in beforehand that those tasks couldn't come in conflict with each other and/or implementing more or less expensive error-routines within the script. Often it's just a question of timing the starts of the tasks.

Beside this errors and/or even delayed finishing of all tasks could occur if the hardware and/or network/storage resources are the bottleneck and couldn't handle the workload properly.

If there are no special needs to run tasks in parallel you shouldn't apply them and if it's necessary an appropriate timing and/or optimizing of the tasks (using incremental approaches, slicing the data and the tasks and similar measures) and/or increasing the available hardware would reduce the risks of getting such errors.

- Marcus

[GD1239 · Accepted solution]

Thank you Marcus for the nice information.

We observed that the Memory is peaking to 100 % when there are multiple tasks hence one of the tasks is failing due to lack of resources. 

Increasing the system resources helped here in this stuation.