Performance issue with tDBConnection

Mayot — Wed, 05 Sep 2018 14:43:27 GMT

Hello,

I am experiencing performance issues when I use the tDBConnection component (associated to tDBInput & tDBOutput) on large volumes of data (instead of classic way with Metadata/Repository). Is this bug known?

Do I have anything special to configure in the project ? or the job ?
I tested with and without auto-commit, it's about the same.

Results for 1,1M rows with the same job :

>> With tDBConnection = 45-48 min

>> Without tDBConnection = 10-12min

Re: Performance issue with tDBConnection

fdenis — Wed, 05 Sep 2018 14:53:10 GMT

if you are using dbconnection for 2 components one select one update, it may take more time due to single way , try to add a second connection only for select.

topic Performance issue with tDBConnection in Talend Studio

Performance issue with tDBConnection

Re: Performance issue with tDBConnection