tDBOutput taking longer time to Update records

[Dhanoop]

Hi Team

I have around 100K records that needs to be updated. I need to set a flag value to "Y" for these records.
I am storing these records in a text file and is updating using tDBOutput component in Talend. This is taking longer time to execute.
I have enabled the parallel execution as well.

I cannot use Bulk Components as this requires permission to create and delete tables.

Please help me in improving performance using tDBOutput component.

Thanks

[Dave_Simo]

Hello @Dhanoop 

To speed up the update you can configure the tDBOutput component as below.

Best Regards

[Dhanoop]

Thanks for the reply.

I am already using this parameter and setting the batch size to 10000.

Thanks

[Dave_Simo]

Hello @Dhanoop ,

So I see three possibilities:

Either reduce the batch size.

Or write your update request in a tDBRow.

Or use a tELTDBOutput component.

Best Regards

[mchapman]

Depending on the database that you are working with, you may find an Advanced setting for the component that controls the commit batch size:

For 100K records, you should see a process time of just a few seconds/minutes depending on the record size. Also, maybe you need to increase the memory of the JVM: