topic Re: Load all data from Rest API using pagination in App Development

Load all data from Rest API using pagination

SunainaUmberkar — Wed, 26 Apr 2023 10:48:54 GMT

Hello,

I have a scenario. I have a Rest API from where i need to load data. In the API, there is a limit set to 25 and i can load only 25 records at a time. I need to apply a loop to load data from the API based on a URL.

I tried to use Pagination type NextURL.

Can anyone help on how to apply loop on NextURL.

How can we achieve that? can someone help please.

Thanks in advance.

Re: Load all data from Rest API using pagination

SBN — Wed, 03 May 2023 18:49:27 GMT

Hi there SunainaUmberkar,

I did the following this week when I needed to add an API with the REST Connector:

Call the API, in this case an anonymous API, in the browser to check what the pagination "key" is on the initial call.

Then I created a loading script like this:

--------------------------------------------------------
Let vNextURL = "initial url";

Do While vNextURL <> Null()

Load data from API;

[NextURL]:
Load Distinct "nexturlfield"
Resident [DataFromAPI];

Let vNextURL = FieldValue('nexturlfield', 1);

Trace URL: $(vNextURL);

Load data into final Table;

Loop
--------------------------------------------------------

Check out this document for Do..loop | Qlik Sense on Windows Help

Hopefully this will get you on the right track.

Kind regards,

SBN

Re: Load all data from Rest API using pagination

marksouzacosta — Sat, 15 Jun 2024 22:11:01 GMT

As an addition to this topic, I'm excited to share my latest tutorial on integrating Asana with Qlik Cloud using REST APIs!

In this step-by-step guide, you'll learn:
- How to use Asana REST APIs with Postman
- Creating REST Data Connections in Qlik Cloud
- Extracting data from Asana and saving as Parquet files
- Enhancing connections with custom parameters and pagination

Check out the full video on YouTube:
Integrate Asana with Qlik Cloud Using REST APIs: A Step-by-Step Guide
https://youtu.be/lFwar30BNkQ?si=UZoM_x9L5amdJSnf

Regards,

Mark Costa