topic Re: How can I run multiple Data Mart Post Loading ETL in parallel in Qlik Compose

How can I run multiple Data Mart Post Loading ETL in parallel

Hrishikesh — Fri, 14 Mar 2025 20:49:07 GMT

We created 4 Post Loading ETL scripts in Snowflake for Data Mart, each one runs for ~ 30 to 40 secs. Is there a way for me to run them in parallel?

Re: How can I run multiple Data Mart Post Loading ETL in parallel

TimGarrod — Tue, 12 Jan 2021 14:52:08 GMT

Hi @Hrishikesh - currently the Post load ETL steps execute serially in Compose. The only way to have Compose execute additiional statements in parallel would be to create multiple Command Tasks and put them in a workflow in Compose.

If executing Post Load ETL for Data Marts in parallel is an important feature - please use the Ideation section of this community to post an idea / feature request and tag it for Qlik Compose.

Re: How can I run multiple Data Mart Post Loading ETL in parallel

rudyreeder — Mon, 26 Apr 2021 07:48:29 GMT

@TimGarrod wrote: run 3
Hi @Hrishikesh - currently the Post load ETL steps execute serially in Compose. The only way to have Compose execute additiional statements in parallel would be to create multiple Command Tasks and put them in a workflow in Compose.
If executing Post Load ETL for Data Marts in parallel is an important feature - please use the Ideation section of this community to post an idea / feature request and tag it for Qlik Compose.

Okay, that makes sense. Thanks for the answers.