I have a requirement where I need to schedule one compose workflow from 5 AM EST to 10 PM EST, is it possible to build a cron expression which can be used to for my requirement.
I know the cron expression for compose is in UTC so I tried 0 0/2 9-1 * * ? will it work? Any valuable suggestions are greatly appreciated.
If you can setup AWS Airflow to call the Composcli.exe run_task and can pass the required input parameters then it should work.
C:\Program Files\Qlik\Compose\bin>ComposeCli.exe run_task --help ComposeCli 2021.8.0.493 Copyright c 1995-2022 Qlik
-p, --project Required. The Compose project name.
-t, --type Required. The type of task to run. Specify DW to run a data warehouse task, DM to run a data mart task, storage to run a data lake storage task or WF to run a workflow task.
-n, --task Required. The name of the task to run (when --type DW or storage), the name of the data mart to populate (when --type DM), or the name of the workflow to run (when --type WF).
-w, --wait (Default: -1) The time to wait in seconds. The default mode is async with a value of -1 (command returns to prompt immediately). Note that when using the default async mode, the command returns success if the workflow starts successfully, even though it may encounter an error later.
Just to add to Shashi's response - you could also use Qlik Enterprise Manager's REST API features to start Compose tasks if you prefer a REST API methodology.
QEM has Run, Status and Stop API's that support Qlik Compose tasks.
Thanks Shashi for providing the detailed information. We are currently using 7.0.0.651 version of compose. Is AWS Airflow compatible with the compose version that we are using?
7.0.0.651 version also has the same ComposeCli run_task command and should not be an issue using it with AWS Airflow CLI.
C:\Program Files\Attunity\Compose for Data Warehouses\bin>ComposeCli.exe run_task --help ComposeCli 7.0.0.651 Copyright c 1995-2022 Qlik
-p, --project Required. The Compose project name.
-t, --type Required. The type of task to run. Specify DW to run a data warehouse task, DM to run a data mart task or WF to run a workflow task.
-n, --task Required. The name of the ETL Set to run (when --type DW), the name of the data mart to populate (when --type DM), or the name of the workflow to run (when --type WF).
-w, --wait (Default: -1) The time to wait in seconds. The default mode is async with a value of -1 (command returns to prompt immediately). Note that when using the default async mode, the command returns success if the workflow starts successfully, even though it may encounter an error later.
