topic Re: Automation In Qlik Cloud Analytics in Qlik Automate

Automation In Qlik Cloud Analytics

Raju_6952 — Tue, 11 Mar 2025 06:56:15 GMT

Hi,

I am using one of of the automation as a task chain where I have configured with 30 app reloads in a single automation but the problem is its getting timed out at 4 hrs. so planning to split the automation into two parts like 15 and 15.My idea here is that my second automation would triggered based on the first automation run is successful.

Any suggestions would be highly appreciated.

Regards,

Raju

Re: Automation In Qlik Cloud Analytics

Dave_Channon — Tue, 11 Mar 2025 12:44:22 GMT

Hi @Raju_6952

There are several ways of achieving this, one is to use a runner such as documented here: https://qlik.dev/manage/reloads/task-chaining-automations/

Re: Automation In Qlik Cloud Analytics

marksouzacosta — Tue, 11 Mar 2025 14:06:47 GMT

Hi @Raju_6952 ,

You may find some help on this topic.
Re: Trigger second automation when the first autom... - Qlik Community - 2507964

One other thing, if possible, you can run your App Reloads in parallel instead of sequentially. This will reduce the automation time.

Regards,

Mark Costa

Re: Automation In Qlik Cloud Analytics

Raju_6952 — Wed, 12 Mar 2025 08:24:53 GMT

Hi @marksouzacosta ,

Thanks for sharing the details but the problem is when we use webhook option to trigger the second part of automation ist getting timedout at 15minutes so we are not able to proceed further.

even we cant use single aumotaion runs as our app reloads take more than 4 hrs but the timeout for each automation is 4 hours

Please let me know if any alternative ways are there.

Regards,

Raju

Re: Automation In Qlik Cloud Analytics

marksouzacosta — Wed, 12 Mar 2025 13:53:11 GMT

Hi @Raju_6952,

Can you please share a screen shot of both of your Automations?
In the second automation, what is the block that is timing out in 15min?

Regarding the 1st Automation, you don't need to hold your automation to wait for the application to reload. You can call the Do Reload block but setting it to not stop the flow of the Automation. If you have some dependency on the Application Reload, you can create another Automation that triggers when the App Data is updated (webhook). However, 4h is a long run even for the application. Maybe I can also help to improve the performance of this application.

Regards,

Mark Costa

Re: Automation In Qlik Cloud Analytics

Raju_6952 — Thu, 13 Mar 2025 05:14:13 GMT

Hi @marksouzacosta ,

here we are reloading 35 apps in sequence as a task chain as its getting timedout we are spltting that automation to two parts .

in the second automation as we are depending on the webhook the timeout is 15 mins so basically the second automation will work until 15 mins and it fails.

Regards,

Raju

Re: Automation In Qlik Cloud Analytics

marksouzacosta — Fri, 14 Mar 2025 12:55:39 GMT

Maybe there are better options for you but I need to understand better the problem.

Why are you running the apps in sequence? They do depend on each other?
The 15min timeout is odd. Which block is timing out?

Regards,

Mark Costa

Re: Automation In Qlik Cloud Analytics

Raju_6952 — Sun, 16 Mar 2025 08:19:33 GMT

Hi @marksouzacosta ,

We are running the apps in sequence as They do depend on each other. as we have automation time limit is set to 4 hrs we have spillited them into two which contains 18 and 17 but the problem is when we trigger second automation once the first automation completed then the second automation is getting timeout at 15 minutes as we dependent on the webhooks.

Platform limitations for automation execution time

Thanks for the hint.

Regards,

Raju

Re: Automation In Qlik Cloud Analytics

marksouzacosta — Sun, 16 Mar 2025 23:51:13 GMT

Interesting...

One solution that I have used with success in some customers was to add a Procedure at the end of the Load Script of each application that will reload the next application.

This is how it works:

Step 1: Create a REST Connection - check Allow With Connection - to the Qlik Cloud Post Reload API - https://qlik.dev/apis/rest/reloads/#post-v1-reloads

Step 2: Create an external QVS file. Inside this QVS file you have a Procedure/Sub - let's call it ReloadApp - that has as parameter AppID. This code only executes the REST Connection created on Step 1.

Step 3: In your Qlik App Load Scripts, you have to include the QVS file created on Step 2.
https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Scripting/SystemVariables/Include.htm

Step 4: The last line of your Load Script will be:
Call ReloadApp('yournextappid');

You can start simple like I have suggested, but you can make this as advanced as you like. You can track the progress of the tasks writing QVDs/Parquets as logs, write try/catch methods on the ReloadApp procedure - I have a very fancy code that mimics Polly (https://www.pollydocs.org/), you can even do AWS Lambda functions, create a multi-dependency, etc.

Regards,

Mark Costa

Re: Automation In Qlik Cloud Analytics

Raju_6952 — Mon, 17 Mar 2025 06:12:38 GMT

Hi @marksouzacosta ,

Thanks for providing this option, while creating a rest connection using post command its not working without specifying the appid.

Regards,

Raju

Re: Automation In Qlik Cloud Analytics

Raju_6952 — Mon, 17 Mar 2025 06:44:49 GMT

Hi @marksouzacosta ,

$(Must_Include=lib://DataFiles/ReloadApp.qvs);

AppIDs:
Load * Inline [

AppID
appid1

appid2

appid3
];

FOR i = 1 TO NoOfRows('AppIDs')
LET vAppID = Peek('AppID', $(i) - 1, 'AppIDs');
Call ReloadApp('$(vAppID)');
NEXT

I am using above script but giving unknow statement error.

Regards,

Raju

Re: Automation In Qlik Cloud Analytics

marksouzacosta — Mon, 17 Mar 2025 15:29:11 GMT

Regarding the REST Connection, every time you create a REST Connection Qlik in fact executes the command. So, in the POST Connection you must provide valid parameters.

Re: Automation In Qlik Cloud Analytics

Raju_6952 — Mon, 17 Mar 2025 15:36:18 GMT

Hi @marksouzacosta ,

I have configured with correct details and used in of the appid to create the connection in the requested body parameters.

When I am looping through each appid I am getting error while executing the qvs file.

Regards,

Raju

Re: Automation In Qlik Cloud Analytics

marksouzacosta — Mon, 17 Mar 2025 16:02:13 GMT

Can you please also share the code in your QVS file? I think it is something there.

One note: reloading your applications like that will not load them in sequence, but in "parallel"- or close to this. The Post Reload request will not wait the reload to finish to call the next one. That is why I have recommended to add the Call ReloadApp Sub at the end of every Load Script of every application.

Re: Automation In Qlik Cloud Analytics

Raju_6952 — Mon, 17 Mar 2025 16:17:16 GMT

Hi @marksouzacosta ,

LIB CONNECT TO 'ReloadsAPI';

SUB ReloadApp(AppID)
TRACE 🔄 Starting reload for AppID: $(AppID);

// Create JSON body with AppID
LET vJSONBody = '{ "appId": "' & '$(AppID)' & '" }';

// Make API call to trigger app reload
REST_Reload:
LOAD
id AS ReloadID
FROM [lib://ReloadsAPI]
(REST, WITH CONNECTION (BODY "$(vJSONBody)"));

// Capture the reload ID from API response
LET vReloadID = Peek('ReloadID', 0, 'REST_Reload');

// Log success or failure
IF Len(Trim(vReloadID)) > 0 THEN
TRACE ✅ Reload triggered successfully for AppID: $(AppID), Reload ID: $(vReloadID);
ELSE
TRACE ❌ Reload failed for AppID: $(AppID);
ENDIF
END SUB;

LIB CONNECT TO 'ReloadsAPI';

SUB ReloadApp(AppID)
TRACE 🔄 Starting reload for AppID: $(AppID);

// Create JSON body with AppID
LET vJSONBody = '{ "appId": "' & '$(AppID)' & '" }';

// Make API call to trigger app reload
REST_Reload:
LOAD
id AS ReloadID
FROM [lib://ReloadsAPI]
(REST, WITH CONNECTION (BODY "$(vJSONBody)"));

// Capture the reload ID from API response
LET vReloadID = Peek('ReloadID', 0, 'REST_Reload');

This is the script I am using in qvs file.

can you give me some example which needs to be called.

Regards,

Raju

Re: Automation In Qlik Cloud Analytics

marksouzacosta — Mon, 17 Mar 2025 16:37:13 GMT

I did some adjustments to your code. This should work if I haven't missed anything:

SUB ReloadApp(AppID) TRACE :counterclockwise_arrows_button: Starting reload for AppID: $(AppID); // Create JSON body with AppID LET vJSONBody = '{""appId"":""$(AppId)"",""partial"":false}'; LIB CONNECT TO 'ReloadsAPI'; // Make API call to trigger app reload REST_Reload: SQL SELECT "id" FROM JSON (wrap on) "root" WITH CONNECTION ( BODY "$(vJSONBody)" ) ; // Capture the reload ID from API response LET vReloadID = Peek('id', 0, 'REST_Reload'); // Log success or failure IF Len(Trim('$(vReloadID)')) > 0 THEN TRACE :white_heavy_check_mark: Reload triggered successfully for AppID: $(AppID), Reload ID: $(vReloadID); ELSE TRACE :cross_mark: Reload failed for AppID: $(AppID); ENDIF END SUB;

Then, at the end of first application Load Script you will add the include statement and this line:

Call ReloadApp('e104b1ef-0747-48e1-9947-79537aaa8558'); // The AppID of the next Application

Regards,

Mark Costa

Re: Automation In Qlik Cloud Analytics

tolange — Mon, 17 Mar 2025 16:47:42 GMT

Interesting approaches.

What I did is to have a main automation that handles the reload chains high-level and on the fly creates automations to perform (trigger) the actual reloads. These ephemeral automations then, upon completion, clean up after themselves - trigger their own deletion.

Re: Automation In Qlik Cloud Analytics

marksouzacosta — Mon, 17 Mar 2025 17:27:57 GMT

Hi @tolange,

I usually avoid using automations due the high frequency of the reloads needed and the limited amount of Automation Calls per month - and the limitations of designing complex tasks dependencies. I ended creating my own Task Manager only using Qlik Load Script and Qlik APIs - but this is another story.

Fortunately, new changes are coming to Qlik Cloud Subscriptions that will increase the number of Automation Calls and we may have soon the Qlik Cloud official Task Manager.

Regards,

Mark Costa

Re: Automation In Qlik Cloud Analytics

Raju_6952 — Tue, 18 Mar 2025 05:00:54 GMT

Hi @tolange ,

can you explain this deeper or share any community article which helps us in setting the process flow.

Regards,

Raju

Re: Automation In Qlik Cloud Analytics

Raju_6952 — Tue, 18 Mar 2025 05:54:02 GMT

Hi @marksouzacosta ,

by using the script you suggested getting below error message.

Regards,

Raju