topic How To connect a URL dynamically in the Load Script in Connectivity & Data Prep

How To connect a URL dynamically in the Load Script

SVM2020 — Wed, 13 May 2020 00:06:04 GMT

I have an API which will return me only 100 records at a time. in order to receive the next 100 records I have to use (URL)+(rec=101) which will get me next 100 rec. Similar way I have to collect all the data for the day and store them in a QVD to use in an app. The data source is a CSV file.

[Data_Extract]:

LOAD

channel,

agent,

record_number

FROM CSV (header on, delimiter ",", quote """") "Data_Extract" QDL

WITH CONNECTION (
url "$(resturl)""$(RecMax)",
QUERY "type" "CSV",
QUERY "size" "",
HTTPHEADER "auth_type" "token",
HTTPHEADER "token" "11111111111111111",
BODY "Post this");

I am not getting the values correctly.

here resturl is the url and RecMax is the Max(Num_of_rec) from the QVD of first 100 records extracted manually.

I am not sure how to proceed on this. Please give me some suggestion to proceed on the right direction.

Re: How To connect a URL dynamically in the Load Script

ToniKautto — Wed, 20 May 2020 00:53:35 GMT

I can not tell from you example how you increment the record position in the URL.

Have you looked at any example like this, on how to iterate over multiple URL requests during load?

https://community.qlik.com/t5/Qlik-Design-Blog/REST-connector-Using-WITH-CONNECTION/ba-p/1523257

Re: How To connect a URL dynamically in the Load Script

SVM2020 — Wed, 20 May 2020 14:12:28 GMT

Thanks Tonikautto. It works.