topic Re: Commit size with tOracleConnection component (Talend 7.3.1) in Talend Studio

Commit size with tOracleConnection component (Talend 7.3.1)

Michele3 — Sat, 16 Nov 2024 00:58:16 GMT

Hello,

I am using Talend Open Studio for Big Data 7.3.1 for reading and writing to Oracle databases. Since this operation involves about 10 million rows, I would like yo use a commit size of 10 000 rows, for improving the performance of the job. Is there a way to set it?

In the advanced settings of the tOracleConnection component I can only find the Auto Commit option. With that one flagged, the job commits every row; if I leave it unchecked it commitsall the 10 million rows at the end of the job. And both these two options are not convenient to me.

Thanks in advance,

Michele

Re: Commit size with tOracleConnection component (Talend 7.3.1)

Anonymous — Fri, 11 Dec 2020 05:06:50 GMT

Hello,

Commit every option is available in TalendHelpCenter: tOracleOutput.

Please refer to component reference for more details.

Best regards

Sabrina

Re: Commit size with tOracleConnection component (Talend 7.3.1)

Michele3 — Fri, 11 Dec 2020 07:52:38 GMT

Hello Sabrina,

could you give me more details? In my job, I have a tOracleOutput component that uses an existing connection (in which I left the "Auto Commit" option unchecked). The only advanced setting I see are the ones in the screenshot below. There isn't any "Commit every" option.

Thanks,

Michele

Re: Commit size with tOracleConnection component (Talend 7.3.1)

Anonymous — Mon, 14 Dec 2020 05:17:45 GMT

Hello,

Please have a look at my screenshot.

Best regards

Sabrina

Re: Commit size with tOracleConnection component (Talend 7.3.1)

Michele3 — Thu, 17 Dec 2020 14:23:15 GMT

Hello Sabrina,

thanks for the support, I have finally understood the issue.

I can't see the "Commit every" option if I flag "Use an existing connection" in the tDBOutput component. I have therefore left that one unchecked and inserted the DB address.

Now everything works fine 🙂

Cheers,

Michele

Re: Commit size with tOracleConnection component (Talend 7.3.1)

Anonymous — Mon, 21 Dec 2020 03:46:48 GMT

Hello,

Great it works.

It's a design choice from us the developers. This property is simply not compatible with connection component.

tOracleConnection where designed so that user can control the transactions.

Best regards

Sabrina