topic Re: Iterate through rows and on SubJobOk insert in SQL table in Talend Studio

Iterate through rows and on SubJobOk insert in SQL table

Riga — Sat, 16 Nov 2024 00:18:30 GMT

Hi,

I have a job that retrieves the data from a SQL table (tDBInput) and it iterates through the rows (tFlowIterate) to modify the data by using a code routine in tJavaRow. Once the data is modified, each row is then inserted into an SQL table inside a different database (tDBOutput).

When running the job, I found that it is taking a long time to insert each row. Is there a way to store the modified rows in a temporary table/Hash table udring the iteration, and on SubJobOk insert all rows in the table at one go ?

Re: Iterate through rows and on SubJobOk insert in SQL table

gjeremy1617088143 — Tue, 06 Apr 2021 17:49:13 GMT

Hi , in your case you can iterate on a buffer.( see tbuffer component or thash component). And then when all your row are iterated Send all the buffer in the tdboutput.

Re: Iterate through rows and on SubJobOk insert in SQL table

gjeremy1617088143 — Tue, 06 Apr 2021 17:50:49 GMT

https://help.talend.com/r/SYSqgEUQmeGfcrdYBvw23A/b1y2CiTp6KiH14air4umpQ

https://help.talend.com/r/FxQ~fVoejm4tx2lTyPUeMg/29Mdi2k4XfP1f7F2twyX_A

Re: Iterate through rows and on SubJobOk insert in SQL table

Riga — Wed, 07 Apr 2021 05:54:30 GMT

I used the tbuffer component and it worked like a charm. The job is much faster now.

Thanks for your help.