topic Re: tOracleOutput is very slow with existing connection in Talend Studio

tOracleOutput is very slow with existing connection

Anonymous — Sat, 16 Nov 2024 12:31:30 GMT

I've created a simple job to load data into Oracle DB using tOracleOutput component.
When using exiting connections this component loads approximately 10 rows at a time. If clean up this checkbox load rates increases to 4000. Connection settings in both cases are taken from repository and absolutely identical.
This problem was already discussed here https://community.talend.com/t5/Archive/resolved-trestclient-as-lookup-into-map/td-p/182213 and issue was raised here https://community.talend.com/t5/Design-and-Development/field-concatenation/td-p/110651. However, issue was closed without any suggestion what should be done in cases when load should happen in one transaction (for example parent and child load or processing data incrementally).
Can anybody please advise how can performance be improved without implementing cumbersome workarounds?
I use TOS 4.2.2.

Re: tOracleOutput is very slow with existing connection

Anonymous — Mon, 05 Dec 2011 23:18:42 GMT

Can you give more information? Screenshots?

Re: tOracleOutput is very slow with existing connection

Anonymous — Tue, 06 Dec 2011 00:53:35 GMT

Advanced settings for the component which don't use tOracleConnection: Batch size = 10000 Commint every = 10000

Re: tOracleOutput is very slow with existing connection

Anonymous — Tue, 06 Dec 2011 02:49:17 GMT

Check if the "commit automatic" is desabled in your tOracleConnection.

Re: tOracleOutput is very slow with existing connection

Anonymous — Tue, 06 Dec 2011 17:53:18 GMT

tOracleConnection "Auto commit" is disabled
As far as I understand from the previous discussion threads, batch load is deliberately disabled when using existing connection, because of memory problems.
I wonder, how then it is possible to implement transactional load with acceptable performance?