Question: how many datamart can we run in parallel?

[garyclark]

Scenario : DWH has data for all the client where as data mart is client specific so we would like to know the maximum number of Datamart's that can be added to a work flow and how many data marts will be executed parallelly when we start the work flow. Currently I have tested by adding  3 DataMart's  to work flow as shown in below picture.
Thanks in advance.

[TimGarrod · Accepted solution]

The limit would really be based on the cores and memory on the Compose server.   Each "TASK"- whether DW ETL or DM processes fires up a JVM which handles thread management , statement execution etc against the dw env. 

The config for the JVM's can be found in the advanced settings for the tasks - it is recommended to leave the defaults and not reduce.  Take the defaults, and compare with your Compose server configuration to determine number of tasks in parallel.   (Note if the server runs out of memory, the task startup will fail and the Compose agent will typically show out of memory errors). 

[Dana_Baldwin]

Hi @garyclark 

Did one (or more) of the comments help you? If so, please mark them as "Accept as Solution".

Thanks!