topic Re: Compose workflow schedule using cron expression in Qlik Compose

Compose workflow schedule using cron expression

NewbieQlik — Fri, 14 Mar 2025 20:49:07 GMT

I have a requirement where I need to schedule one compose workflow from 5 AM EST to 10 PM EST, is it possible to build a cron expression which can be used to for my requirement.

I know the cron expression for compose is in UTC so I tried 0 0/2 9-1 * * ? will it work? Any valuable suggestions are greatly appreciated.

Re: Compose workflow schedule using cron expression

Nanda_Ravindra — Tue, 19 Apr 2022 05:08:40 GMT

Hello @NewbieQlik

What you have in the expression should work. But it's good to test it out. I see you have it scheduled to run every 2 minutes between 5 AM and 10 PM (EST). Is this what you want? If so, what type of job are you trying to run? FL or CDC job ?

Re: Compose workflow schedule using cron expression

NewbieQlik — Tue, 19 Apr 2022 13:30:07 GMT

Yes I wanted to run the wf every 2 mits from 5 AM to 10 PM EST and I am running the CDC job

Re: Compose workflow schedule using cron expression

shashi_holla — Tue, 19 Apr 2022 20:44:05 GMT

Hi @NewbieQlik

Try this 0 0/2 9,10,11,12 * * which should ideally run the job as follows:

Every 2 mins starting 9 AM till 9:58 and next schedule starts at 10 AM till 10:58 and last schedule starts at 12 PM and ends at 12:58 PM.

It's not mentioned that cron job time is in UTC and I'm assuming it will be Compose project settings (UTC/server time) but best to confirm based on the test results.

Thank you,

Re: Compose workflow schedule using cron expression

Nanda_Ravindra — Tue, 19 Apr 2022 21:05:28 GMT

Hello @shashi_holla

Please note, that the request here is to run the cronjob as an expression every 2 minutes between 5 AM and 10 PM (EST) and NOT from 10 AM to 12 PM.

The cronjob time in the UTC time zone will come up as a note when you select the scheduler run job as 'advanced' - see below

Re: Compose workflow schedule using cron expression

shashi_holla — Tue, 19 Apr 2022 21:13:17 GMT

Hi @Nanda_Ravindra 5AM EST is 9AM in UTC and one of the ways how we can do it. Hope this clarifies.

Thank you,

Re: Compose workflow schedule using cron expression

Nanda_Ravindra — Tue, 19 Apr 2022 21:18:19 GMT

Hello @NewbieQlik

Okay, as I mentioned earlier it's best to test this out. Before you schedule this job, I would recommend you set the scheduler to verbose. This way you can see the details in the Compose log for the scheduled job.

To set the verbose for the scheduler:

On the main Compose screen, click Management - Logs - Log Management. Scroll to the bottom and move the slide bar for Scheduler to Verbose, click OK to confirm, and click OK to save and close the Log Management screen.

Below is from my Compose log

"Compose.log"(11710,26):340 2022-04-19 16:56:33 [Scheduler ] [DEBUG] schedule 195 start time at 04/19/2022 20:56:33 +00:00 UTC
"Compose.log"(11711,26):340 2022-04-19 16:56:33 [Scheduler ] [DEBUG] schedule 195 is cron policy, Quartz expression is '0 0/2 9-1 * * ?'
"Compose.log"(11712,26):340 2022-04-19 16:56:33 [Scheduler ] [DEBUG] Job 195_Qjob has been scheduled
"Compose.log"(11713,26):340 2022-04-19 16:56:33 [Scheduler ] [DEBUG] next time is 04/19/2022 20:58:00 UTC
"Compose.log"(11714,26):340 2022-04-19 16:56:34 [Scheduler ] [DEBUG] next time is 04/19/2022 20:58:00 UTC

Let me know how it goes.

Thanks,

Nanda

Re: Compose workflow schedule using cron expression

NewbieQlik — Wed, 20 Apr 2022 13:25:24 GMT

I have tested the cron expression 0 0/2 9-1 * * ? and it is working as expected.

Re: Compose workflow schedule using cron expression

NewbieQlik — Wed, 20 Apr 2022 19:37:57 GMT

I have one more requirement where I need to run another compose wf on BD9 (business day 9) every month. We have a table where we keep tract of whether the day is BD or CD (Calendar day) if the day is BD9 then we should trigger the full load workflow at 10.30 PM. I don't think this is even possible using cron expression. Is there any way I can run the workflow based on the BD requirement? does this require any third party scheduling tool?

Re: Compose workflow schedule using cron expression

NewbieQlik — Fri, 22 Apr 2022 13:32:33 GMT

In my organization we are planning to use AWS Airflow as the enterprise scheduler. Can we use airflow for compose scheduling?

Re: Compose workflow schedule using cron expression

shashi_holla — Fri, 22 Apr 2022 17:23:19 GMT

If you can setup AWS Airflow to call the Composcli.exe run_task and can pass the required input parameters then it should work.

C:\Program Files\Qlik\Compose\bin>ComposeCli.exe run_task --help
ComposeCli 2021.8.0.493
Copyright c 1995-2022 Qlik

-p, --project Required. The Compose project name.

-t, --type Required. The type of task to run. Specify DW to run a data warehouse task, DM to run a data mart task, storage to run a data lake storage task or WF to run a workflow task.

-n, --task Required. The name of the task to run (when --type DW or storage), the name of the data mart to populate (when --type DM), or the name of the workflow to run (when --type WF).

-w, --wait (Default: -1) The time to wait in seconds. The default mode is async with a value of -1 (command returns to prompt immediately). Note that when using the default async mode, the command returns success if the workflow
starts successfully, even though it may encounter an error later.

--help Display this help screen.

--version Display version information.

Thank you,

Re: Compose workflow schedule using cron expression

TimGarrod — Fri, 22 Apr 2022 17:33:48 GMT

Just to add to Shashi's response - you could also use Qlik Enterprise Manager's REST API features to start Compose tasks if you prefer a REST API methodology.

QEM has Run, Status and Stop API's that support Qlik Compose tasks.

https://help.qlik.com/en-US/enterprise-manager/November2021/Content/EnterpriseManager/EnterpriseManager_APIGuide/CurlAPI/api_runTask.htm

Re: Compose workflow schedule using cron expression

NewbieQlik — Mon, 25 Apr 2022 14:04:10 GMT

Thanks Shashi for providing the detailed information. We are currently using 7.0.0.651 version of compose. Is AWS Airflow compatible with the compose version that we are using?

Re: Compose workflow schedule using cron expression

shashi_holla — Tue, 26 Apr 2022 18:28:11 GMT

7.0.0.651 version also has the same ComposeCli run_task command and should not be an issue using it with AWS Airflow CLI.

C:\Program Files\Attunity\Compose for Data Warehouses\bin>ComposeCli.exe run_task --help
ComposeCli 7.0.0.651
Copyright c 1995-2022 Qlik

-p, --project Required. The Compose project name.

-t, --type Required. The type of task to run. Specify DW to run a data warehouse task, DM to run a data mart task or WF to run a workflow task.

-n, --task Required. The name of the ETL Set to run (when --type DW), the name of the data mart to populate (when --type DM), or the name of the workflow to run (when --type WF).

--help Display this help screen.

--version Display version information.

Re: Compose workflow schedule using cron expression

NewbieQlik — Tue, 26 Apr 2022 18:46:24 GMT

Thank you Shashi for the confirmation.