topic Re: Reloading task from script : authentication with saml and multi-node in Integration, Extension & APIs

Reloading task from script : authentication with saml and multi-node

simonaubert — Wed, 17 Feb 2021 08:34:15 GMT

Hello all,

The use case : I need to launch Tasks from the script.
What works :
1.on my dev environment, I created a certificate through https://<myserver>/saml/qmc/certificates
2. I set a certificate password and just put a localhost on the certificate name.
3. I copy pasted it from C:\ProgramData\Qlik\Sense\Repository\Exported Certificates
4. I created a connection like that :

5. I use this script

Let vServer = 'localhost'; Let vTaskName = 'Reload task of Extension.Usage.Dashboard'; Let vURL = '"https://$(vServer):4242/qrs/task/start?name=$(vTaskName) "'; LIB CONNECT TO 'REST_local_Task_Launcher'; RestTable: SQL SELECT FROM JSON (wrap on) "root" WITH CONNECTION ( URL $(vURL) ); Drop Table RestTable; exit script;

So, okay, I somehow cheated a little but that works ! 🙂

And now I have some difficulties doing the same thing on the production environnement. First of all, it's a multi-node.

So what do I have to do with certificate? What machine name? Which certificate do I have to copy on which machine?

Best regards,

Simon

EDIT : detailed procedure on page 2

Re: Reloading task from script : authentication with saml and multi-node

simonaubert — Tue, 06 Oct 2020 08:49:16 GMT

Hello all,

I made it to work in multi-node. Same process except I also copy the client.pfx certificate from the central node on all nodes.

Best regards,

Simon

Re: Reloading task from script : authentication with saml and multi-node

mjperreault — Fri, 12 Feb 2021 23:15:29 GMT

Hi @simonaubert ,

Thanks so much for the response, I have followed your procedure closely but unfortunately I am getting the same error, it does not seem to make sense to me! The connector is definitely recognizing the certificate because if I try and enter the wrong password I get an error for wrong password. Couple more questions

1. Did you export the secret key

2. Did you choose windows format

3. Did you have to restart any services

4. Which version of Qlik Sense are you on

Thanks so much,
Mark

Re: Reloading task from script : authentication with saml and multi-node

Lech_Miszkiewicz — Sun, 14 Feb 2021 22:40:42 GMT

This approach was documented here in qlik support documents: https://support.qlik.com/articles/000048247

Re: Reloading task from script : authentication with saml and multi-node

Sonja_Bauernfeind — Mon, 15 Feb 2021 08:51:52 GMT

Hello all,

The article referenced by Lech was moved to: https://community.qlik.com/t5/Support-Knowledge-Base/How-to-setup-a-Data-Connection-to-the-QRS-API-using-Certificates/ta-p/1712498

Thought I'd let you know to prevent any possible future dead-ends.

Re: Reloading task from script : authentication with saml and multi-node

mjperreault — Mon, 15 Feb 2021 22:53:30 GMT

Hi @Sonja_Bauernfeind & @Lech_Miszkiewicz ,

Thanks so much for your responses, what is very strange is when I follow the steps from the article Lech has posted to create a GET Rest API connection to the repository I am succeeding and getting data from the repository, however when I try and makes a POST Rest API connection using the exact same certificate I am still getting the "HTTP protocol error 403 (No client certificate supplied): The server refused to fulfill the request."

Here is my connection details.

I will make a broader community post to see if anyone else has any thoughts, thanks again.

Mark

Re: Reloading task from script : authentication with saml and multi-node

Damien_V — Tue, 16 Feb 2021 10:08:34 GMT

Hi @mjperreault

Which version of Qlik Sense are you running ? There were some issues with POST calls using certificates in older versions, such as February 2019, April 2019, June 2019.

https://community.qlik.com/t5/Support-Knowledge-Base/Qlik-Sense-REST-connector-cannot-make-POST-calls-403-No-client/ta-p/1717822

Re: Reloading task from script : authentication with saml and multi-node

Lech_Miszkiewicz — Tue, 16 Feb 2021 10:56:50 GMT

I have used different approach and never tried to run POST with URL parameter like "?name=...."

My approach you can see in attached file (have a look at subroutine "QRS_Reload_App_ByName_N_Stream"...).

There are some other subs which are invalid due to fact that I was not able to use "X-HTTP-Method-Override", so please ignore them

thanks

Lech

Re: Reloading task from script : authentication with saml and multi-node

mjperreault — Tue, 16 Feb 2021 13:09:48 GMT

Thanks for your rsponse @Damien_V , I think this is likely the issue! I am on February 2019 and I am able to make the same POST call using postman so it definitely seems like its an issue with the REST connector, I will try the workarounds mentioned in the article as well as the alternate approach @Lech_Miszkiewicz mentioned below.

Thanks again,

Mark

Re: Reloading task from script : authentication with saml and multi-node

mjperreault — Tue, 16 Feb 2021 13:10:14 GMT

@Lech_Miszkiewicz will give this approach a shot, thanks so much!

Re: Reloading task from script : authentication with saml and multi-node

simonaubert — Wed, 17 Feb 2021 08:25:20 GMT

Hello All,
Here is my detailed procedure

1.Connexion setup (the hard part).

In script, create a new connection of type REST

configure it as follow :

URL : https://localhost:4242/qrs/task/start?name=TEST_TASK_SAU
Timeout : 900
Method : Post

HTTP Protocol : 1.1
Request/response body encoding : UTF-8
check :
Add ‘Expect :100-continue’ header,
Auto detect response type,
Check response type during ‘Test connection’

Key generation strategy put to No keys

Authentication Schema : Anonymous
check Skip server certificate validation
use certificate : From File
PFX file name : client.pfx

Write password of the pfx file

Query parameters
Name : xrfkey Value : 0000000000000000
Check « Add missing query parameters to final request »

Query headers:
Name : X-Qlik-XrfKey Value : 0000000000000000
Name : X-Qlik-User Value : UserDirectory=internal; UserId=sa_repository

Name : REST_TASK_LAUNCHER

If the client.pfx file is missing, here what to do :
Go to QMC, on Certificates. Put localhost as machine name and write a password for the certificate. Click on Export Certificate.

Certificate is exported to central node in repository C:\ProgramData\Qlik\Sense\Repository\Exported Certificates

Copy paste it on C:\ProgramData\Qlik\Sense\Engine\Certificates on every node.

Use connexion in script :

//déclenchement de la tâche

Let vServer = 'localhost';

Let vTaskName = '$(v_task_reellement_lancee)';

Let vURL = '"https://$(vServer):4242/qrs/task/start?name=$(vTaskName)"';

trace $(vURL);

LIB CONNECT TO 'REST_TASK_LAUNCHER';

RestTable:

SQL SELECT

FROM JSON (wrap on) "root"

WITH CONNECTION ( URL $(vURL) );

Drop Table RestTable;

Please note there is also an idea to make it native on Qlik Sense here https://community.qlik.com/t5/Ideas/Launch-natively-a-task-from-script/idi-p/1776117

Best regards,

Simon

Edit : images are now available

Re: Reloading task from script : authentication with saml and multi-node

mjperreault — Fri, 19 Feb 2021 17:40:14 GMT

Thanks for your responses everyone, as my issue seems to be related to a bug with REST CONNECTOR and POST requests using certificates, I found a different approach authenticating via PROXY which is working! I got the idea from @ChristofSchwarz video here https://www.youtube.com/watch?v=jiJDDV9B_QU. I used his process to create a POST connection and this worked.

Here are my connection details

Then you can create a script like.

You also need to set up a header virtual proxy but there are thorough details on how to do that in Christof's video

Unfortunately my ultimate goal was to try to create a reload script that would duplicate an app and then replace an existing published app with the duplicate but this is not possible due to "X-HTTP-Method-Override" not working with the REST Connector, bummer!

Re: Reloading task from script : authentication with saml and multi-node

domanski — Wed, 24 Aug 2022 15:33:02 GMT

I had the same problem. I could not etablish a POST command via a certificate from QV to QS. And then i was able to use a POST-command with the virutal proxy of the video from @ChristofSchwarz 🙂
Thank you for all the input in this thread

Re: Reloading task from script : authentication with saml and multi-node

JHuis — Wed, 06 Mar 2024 14:35:41 GMT

EDIT:

It works! thank you for this awesome solution!

@simonaubert ,

i am following every part of your instruction, but when i try to select data from the datasource, i cant find anything.

Hopefully you can help me?

Re: Reloading task from script : authentication with saml and multi-node

fabdulazeez — Thu, 23 May 2024 13:03:47 GMT

Can a PUT method invoked from the script. I can see only GET and POST method while creating connection