Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Want to see what's currently in public preview? We've pulled it all together in one place. Check it out here
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to retrieve all data from REST API using tRestClient?

I'm new to Talend ESB. In this job, I have to retrieve all data from the repository, and our repository have their own REST to get the data. But when I run that REST to get the data, it just returned 100 data. Actually there's more than 100 data. I want to ask, is there any way how to get all the data at once? Can somebody help me, please? I really appreciate it. Thank you0683p000009M8Pk.png

 

Labels (3)
2 Replies
Anonymous
Not applicable
Author

Hi
Check your Rest API if it supports limit and offset parameters, if so, you can do a loop to retrieve all data. Please refer to this topic, it has many discussions and an example.
https://community.talend.com/t5/Design-and-Development/Extract-more-than-10k-records-from-thttpsrequ...

Regards
Shong

TRF
Champion II
Champion II

What if you call the API using a tool such as Postman? I suspect this due to API design and you have to do multiple calls with pagination.