topic Re: tDBOutput taking longer time to Update records in Talend Studio

tDBOutput taking longer time to Update records

Dhanoop — Thu, 03 Apr 2025 08:02:47 GMT

Hi Team

I have around 100K records that needs to be updated. I need to set a flag value to "Y" for these records.
I am storing these records in a text file and is updating using tDBOutput component in Talend. This is taking longer time to execute.
I have enabled the parallel execution as well.

I cannot use Bulk Components as this requires permission to create and delete tables.

Please help me in improving performance using tDBOutput component.

Thanks

Re: tDBOutput taking longer time to Update records

Dave_Simo — Thu, 03 Apr 2025 08:56:11 GMT

Hello @Dhanoop

To speed up the update you can configure the tDBOutput component as below.

Best Regards

Re: tDBOutput taking longer time to Update records

Dhanoop — Thu, 03 Apr 2025 09:29:20 GMT

Thanks for the reply.

I am already using this parameter and setting the batch size to 10000.

Thanks

Re: tDBOutput taking longer time to Update records

Dave_Simo — Thu, 03 Apr 2025 09:41:45 GMT

Hello @Dhanoop ,

So I see three possibilities:

Either reduce the batch size.

Or write your update request in a tDBRow.

Or use a tELTDBOutput component.

Best Regards

Re: tDBOutput taking longer time to Update records

mchapman — Thu, 03 Apr 2025 15:07:27 GMT

Depending on the database that you are working with, you may find an Advanced setting for the component that controls the commit batch size:

For 100K records, you should see a process time of just a few seconds/minutes depending on the record size. Also, maybe you need to increase the memory of the JVM: