topic Question: how many datamart can we run in parallel? in Qlik Compose

Question: how many datamart can we run in parallel?

garyclark — Fri, 14 Mar 2025 20:49:07 GMT

Scenario : DWH has data for all the client where as data mart is client specific so we would like to know the maximum number of Datamart's that can be added to a work flow and how many data marts will be executed parallelly when we start the work flow. Currently I have tested by adding 3 DataMart's to work flow as shown in below picture.
Thanks in advance.

Re: Question: how many datamart can we run in parallel?

TimGarrod — Tue, 08 Feb 2022 17:59:48 GMT

The limit would really be based on the cores and memory on the Compose server. Each "TASK"- whether DW ETL or DM processes fires up a JVM which handles thread management , statement execution etc against the dw env.

The config for the JVM's can be found in the advanced settings for the tasks - it is recommended to leave the defaults and not reduce. Take the defaults, and compare with your Compose server configuration to determine number of tasks in parallel. (Note if the server runs out of memory, the task startup will fail and the Compose agent will typically show out of memory errors).

Re: Question: how many datamart can we run in parallel?

Dana_Baldwin — Thu, 31 Mar 2022 22:55:42 GMT

Hi @garyclark

Did one (or more) of the comments help you? If so, please mark them as "Accept as Solution".

Thanks!