topic Re: Iterate on tRestClient in Talend Studio

Iterate on tRestClient

bradsheridan — Sat, 16 Nov 2024 06:52:18 GMT

Morning Community...I hope this is an easy one

I have this flow:

tRestClient ->tExtractJSONFields -> tFlowtoIterate -> tRestClient2 -> tExtractJSONFields -> tLogRow

I'm trying to take a list of values from the first tRestClient and pass them one-by-one to the second tRestClient. But what's happening is that only the last value is being passed. How can I loop through all values from the first tRestClient?

Thanks!

Re: Iterate on tRestClient

vapukov — Sat, 12 Jan 2019 03:27:38 GMT

your steps sequence is correct, it means - something wrong in settings or job design

you need to share all design, because it very hard to guess - what wrong, but it could be something small issue

Re: Iterate on tRestClient

bradsheridan — Sat, 12 Jan 2019 03:59:09 GMT

Hi Vapukov and thanks for helping out!! I'll do my best...here goes...

Re: Iterate on tRestClient

vapukov — Sat, 12 Jan 2019 04:01:43 GMT

you need change OnComponentOk connection to Iterate on first picture

as variant tFloToIterate -> Iterate -> tJavaFlex -> OnComponentOk -> tRestClient

Re: Iterate on tRestClient

bradsheridan — Sat, 12 Jan 2019 04:14:05 GMT

Vapukov...awesome! that worked!!! (I think...)

Question...so the tJava component is kind of acting like a dummy step simply to get the Iterate functionality?

I say "I think" because in my tLogRow, I can see 40 rows for ticket #1 but when I look in the source system, there appear to only be 31 rows. Then for ticket #2 (the second iteration), I get 20 rows in my tLogRow but there are 35 in source.

It's pretty late here and I'm fried mentally, so I'll check first thing in the morning and update you (and the Community).

Bottom line...you were a HUGE help!! Thanks!!!

Re: Iterate on tRestClient

vapukov — Sat, 12 Jan 2019 04:42:14 GMT

@bradsheridan wrote:

Vapukov...awesome! that worked!!! (I think...)

Question...so the tJava component is kind of acting like a dummy step simply to get the Iterate functionality?

yes, it just a dummy (or you can use it for any other iteration operation)

Re: Iterate on tRestClient

bradsheridan — Sat, 12 Jan 2019 15:27:03 GMT

Morning Vapukov - things are definitely working better. I limited my input set of data to 3 'tickets', each having a varying number of 'revisions'. The resulting tLogRow correctly outputs the data. However, when I remove the tLogRow and try to output the data to a table in Redshift, I'm back to getting only the last ticket in the input data. I tried throwing a tJavaFlex right before the tRedshiftOutput (name 'tfs_boardworkitems in my screenshot below) but that didn't work either.

thoughts?

Thanks

Re: Iterate on tRestClient

vapukov — Mon, 14 Jan 2019 02:52:30 GMT

check - what settings you define for tRedshiftOutput

for example if it truncate (empty) table or drop and create, result would be exactly as described, only last iteration will be saved

Re: Iterate on tRestClient

bradsheridan — Mon, 14 Jan 2019 13:46:20 GMT

Vapukov...sometimes it's the attention to details that makes the difference

I had the Redshift component set to "drop and recreate table if it exists". Changing that to none, leaving the action to Insert, and adding a prejob to truncate the table each run did the trick!!

Thanks again for all your help!!