topic Process 20 records at a time in Talend Studio

Process 20 records at a time

RMotta2408 — Thu, 21 Nov 2024 13:01:37 GMT

Hello everyone,

I have to develop a Job that reads from a table and processes 20 records at a time.
The reason is I have to pass the records from one Database table to another Database through an API, using a JSON body. And the API has this limitation: it only accepts a maximum of 20 records.

The original table has about 180 records and I have to copy them to another table, in a different Database, using this API. But I can only do it using a maximum of 20 records each time.

How do I go about it?

I really appreciate all the help you guys can provide.

Thank you,

Rui

Re: Process 20 records at a time

Shicong_Hong — Mon, 25 Nov 2024 08:45:18 GMT

Perform a loop to read 20 records at a time until all records have been read. Take a look at the tLoop component and learn how to use tLoop component with the while type to perform a loop.

Regards

Shicong

Re: Process 20 records at a time

RMotta2408 — Mon, 25 Nov 2024 11:07:16 GMT

Hi,

Thank you