topic Re: Performance Issue in tOracleOutput (because of Use an existing connection option) in Talend Studio

Performance Issue in tOracleOutput (because of Use an existing connection option)

ashif2 — Mon, 30 Jul 2018 10:56:42 GMT

Why tOracleOutput using existing connection (tOracleConnection) is getting poor performance in comparison to the tOracleOutput which is standalone(it contains the db details in it , hostname ,service name,username ,portnumber and password)?

What is the logic behind this slowness?

What is the correct situation to these differrent options.

Re: Performance Issue in tOracleOutput (because of Use an existing connection option)

Anonymous — Mon, 30 Jul 2018 11:06:13 GMT

Hi Ashif,

How did you measure the performance difference between two scenarios? We will have to make sure that the system resources are aligned same for both cases. If there are any underling queries running in Oracle database, that also can change the statistics.

tOracleconnection just helps to use an existing open connection to do subsequent jobs. Could you check the details DB statistics with the help of an Oracle DBA and let us know whether issue persists?

Warm Regards,

Nikhil Thampi

Re: Performance Issue in tOracleOutput (because of Use an existing connection option)

ashif2 — Mon, 30 Jul 2018 11:16:00 GMT

Hi Nikhil,

Even in a simple scenario , I see the difference

I checked with simple one to one flow,

tOracleConnection

tFileInputDelimited--->tMap--->tOracleOuput(using Use an existing connection) its **bleep** slow.

When I update the job like below

tOracleConnection

tFileInputDelimited--->tMap--->tOracleOuput(in-built connection details), the throughout is high .

Whats happening internally , I'm not sure ?

Re: Performance Issue in tOracleOutput (because of Use an existing connection option)

Anonymous — Mon, 30 Jul 2018 11:26:06 GMT

Hi,

Please check the batch size of the tOracleOutput component whether it is too low. Could you please quantify the time difference between both ways of data loading?

If you are absolutely sure that all the other parameters remain same (CPU utilization, number of connections, commit size memory usage in Talend and DB servers etc.) , culd you please log a JIRA ticket with details so that R&D team can have a look into it. The link for JIRA is as shown below.

https://jira.talendforge.org

Warm Regards,

Nikhil Thampi

Re: Performance Issue in tOracleOutput (because of Use an existing connection option)

Anonymous — Tue, 31 Jul 2018 09:40:18 GMT

Hi,

Yes even I faced performance issues with use an existing conn enabled for tOracleOutput during the data loading.If it leads to performance issues then whats the use of tOracleConnection when I would like to connec to same db multiple times and ending up with performance issues.

Thanks,

Kiran Kumar