Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to retrieve all data from REST API using tRestClient?

I'm new to Talend ESB. In this job, I have to retrieve all data from the repository, and our repository have their own REST to get the data. But when I run that REST to get the data, it just returned 100 data. Actually there's more than 100 data. I want to ask, is there any way how to get all the data at once? Can somebody help me, please? I really appreciate it. Thank you0683p000009M8Pk.png

 

Labels (3)
2 Replies
Anonymous
Not applicable
Author

Hi
Check your Rest API if it supports limit and offset parameters, if so, you can do a loop to retrieve all data. Please refer to this topic, it has many discussions and an example.
https://community.talend.com/t5/Design-and-Development/Extract-more-than-10k-records-from-thttpsrequ...

Regards
Shong

TRF
Champion II
Champion II

What if you call the API using a tool such as Postman? I suspect this due to API design and you have to do multiple calls with pagination.