topic Re: Shared Oracle DB Connection and Parallelism in Talend Studio

Shared Oracle DB Connection and Parallelism

PSanadi — Sun, 30 Apr 2023 15:11:11 GMT

Hi All,

We are using tOracleConnection component with shared DB connection enabled. Once we register this connection there are multiple subjobs running in parallel using tParallelize and tFlowtoIterate to fetch data using select queries to write to a file. We are observing slowness in all the subjobs, can this be issue with shared connection ? How does shared connection with multiple subjobs executing in parallel works ?

Re: Shared Oracle DB Connection and Parallelism

Anonymous — Tue, 02 May 2023 08:24:51 GMT

Hello,

It depends on the driver. Some drivers create a connection that makes all the parallel queries to single threaded. Some drivers allow the use of connection pool so a single connection can be used from multiple thread.

Sometimes this pooling is controlled by parameters.

I personally would run some tests (a simple DBMS_SESSION.SLEEP could help) and see how the runtime changes.

If you want to get an ide what happens inside the JDBC driver you can do that via visualVM or JFR recoridng as described here: https://community.talend.com/s/article/Using-VisualVM-to-record-Java-Issues?language=en_US

Re: Shared Oracle DB Connection and Parallelism

PSanadi — Tue, 02 May 2023 09:05:26 GMT

Thanks, but we are using standard ojdbc jar provided by Talend studio - ojdbc8-19.3.0.0.jar

Any idea on how this jar works for our scenario.