topic Talend Development in Talend Studio

Talend Development

SreejithSL — Mon, 01 Nov 2021 15:16:54 GMT

Hello All,

I have a scenario to extract json responses from a REST API. I designed a workflow using the components tRestClient , tExtractJsonFields and then write to DBtable. This design work as per the requirement,however, I could not extract whole responses if it is greater than 40 . On a single iteration my workflow can only extract responses upto 40 ,although ,it is greater than 100 responses in the json .

I request your time and inputs in order to tackle this problem. ,

Thanks,

Sreejith

Re: Talend Development

Anonymous — Tue, 02 Nov 2021 07:07:40 GMT

I think it is an API limitation, we usually do a loop to call the API multiple times by setting the parameters like offset, limit, page, size until all records are retrieved. Please go to check whether your API has these parameters?

Regards

Shong

Re: Talend Development

SreejithSL — Tue, 02 Nov 2021 10:26:16 GMT

Hi Shong,

Appreciate your response.Exactly this is an API limitation , the response from the API is by default as 25 and the maximun response it can provided as 1000. There is query parameter in the API definition to provide the page_size and if I provide the page size to max size that is 1000,then it would takle my problem .

Thank You....