topic Re: Loop in tRestClient (check value in row) in Talend Studio

Loop in tRestClient (check value in row)

Anonymous — Sat, 16 Nov 2024 04:32:12 GMT

Hello everyone!

I has this flux: tloop -> iterateToFlow -> RestClient.

I need execute this flux when there is value in execution.

I need tloop to just execute while it comes back from api, if there is no return I need to stop loop

I try put tjava, but I don't know where to put the component.

This api request has 94 pages, this loop start 1 and stop at 94 based on page records.

Each page brings me 100 'records', if I loop it works fine, but I need it automatically as it will come online on a server using crontab.

Re: Loop in tRestClient (check value in row)

vapukov — Mon, 30 Sep 2019 08:46:00 GMT

you can use tLoop (While)

for example:

define boolean context or global variable

context.do_iterate = true;

than in tLoop use single condition

context.do_iterate

loop will work infinite until the condition is true

after tExtractJSONFields you can add tJava component and reset variable if data is empty

context.do_iterate = false;

Re: Loop in tRestClient (check value in row)

Anonymous — Sat, 26 Oct 2019 20:06:14 GMT

@vapukov wrote:

Hi

you can use tLoop (While)

for example:

define boolean context or global variable

context.do_iterate = true;

than in tLoop use single condition

context.do_iterate

loop will work infinite until the condition is true

after tExtractJSONFields you can add tJava component and reset variable if data is empty

context.do_iterate = false;

Sorry for the delay, but how will check if data is empty?
Can you help about code?
In the meantime I'll try to build something

Re: Loop in tRestClient (check value in row)

Anonymous — Sun, 27 Oct 2019 03:33:18 GMT

You can link tExtractJsonField to a tJavaFlex, define a counter on tJavaFlex, if the counter is 0, means no data are return.
....tExtractJsonField--main--tJavaFlex
on tJavaFlex:
in the begin part:
int counter=0;
in the main main part:
counter++;

In the end part:
if(counter==0){
context.do_iterate=false;
}else{
context.do_iterate=true;
}

Hope it helps you!

Re: Loop in tRestClient (check value in row)

Anonymous — Sun, 27 Oct 2019 13:44:54 GMT

Hello,

When I set do_iterate = true, the flow are infinity.

The process doesn't continue for next step.

Is it correct do_iterate in condition, because how does the process know to do the rest?

Re: Loop in tRestClient (check value in row)

Anonymous — Mon, 28 Oct 2019 02:31:59 GMT

Do each API calling will return one page and the page will contain 0 or several records? If it is 0, you want to stop the loop?

Re: Loop in tRestClient (check value in row)

Anonymous — Mon, 28 Oct 2019 15:43:14 GMT

@shong wrote:
Do each API calling will return one page and the page will contain 0 or several records? If it is 0, you want to stop the loop?

Yes, I need this. When 0, it stops.

Re: Loop in tRestClient (check value in row)

Anonymous — Tue, 29 Oct 2019 03:09:28 GMT

Change the job design as below:
tLoop--iterate--tJava1--oncomponentok-->RestClient-->tExtractJsonField-->tJavaRow--oncomponentok--tJava2

on tJava1:
context.counter=0;

on tJavarow:

context.counter++;

on tJava2:
if(context.counter==0){
context.do_iterate=false;
}else{
context.do_iterate=true;
}

//Define another context variable called counter, int type.

Please test and let me know if it works.

Re: Loop in tRestClient (check value in row)

Anonymous — Sun, 03 Nov 2019 22:11:38 GMT

I trying to use your model, but I have similar problem. Because tloop -> do_iterate = true, does not go to the next step, becomes infinite.

I stopped manual this execution.

Re: Loop in tRestClient (check value in row)

Anonymous — Mon, 04 Nov 2019 03:12:08 GMT

Can you upload a screenshot of tRestClient component? I want to see that your each API calling return different response rather than the same response.

Re: Loop in tRestClient (check value in row)

Anonymous — Fri, 15 Nov 2019 18:18:39 GMT

Sorry, follow the image as requested.

Re: Loop in tRestClient (check value in row)

Anonymous — Sun, 17 Nov 2019 01:56:10 GMT

For testing, need to make some testing to make sure each API calling returns different records, and one page has 0 record. To do it, add a tLogRow after tExtractJsonField to print the records on the console.