topic Re: Commit every... with existing connection in Talend Studio

Commit every... with existing connection

_AnonymousUser — Sat, 16 Nov 2024 14:22:23 GMT

I am trying to load data into oracle using TOS 2.3.3.
1) I have main connection that goes from my file to tOracleOutput.
2) I use the existing connection.
3) I want to commit every 10000 rows.
Is there a way to implement this kind of load in Talend?
I understand that I can do it if I don't use existing connection (there is a Commit Every... field on the Advanced Settings tab, but it disappears when I switch to "use existing connection"). Why can't I do it with the existing connection? Is there a reason or am I missing something?

Re: Commit every... with existing connection

Anonymous — Wed, 14 May 2008 23:15:42 GMT

Why can't I do it with the existing connection? Is there a reason or am I missing something?

It's a design choice from us the developers. tOracleConnection/tOracleCommit/tOracleRollback where designed so that user can control the transactions.
Workaround:
tFileInputDelimited --row--> tOracleOutput --row--> tFilterRow --row--> tOracleCommit
in the tFilterRow, advanced mode:

sequence('abcd', 1, 1) % 10_000 == 0

Don't forget to add a tOracleCommit after the subjob, so that last lines are commited.
May I ask you to add a feature request "add a commit every in t*Commit"? I think it would be much more user friendly than the tip I just gave you.

Re: Commit every... with existing connection

_AnonymousUser — Thu, 15 May 2008 14:46:43 GMT

Why can't I do it with the existing connection? Is there a reason or am I missing something?

sequence('abcd', 1, 1) % 10_000 == 0

Re: Commit every... with existing connection

Anonymous — Thu, 01 Dec 2011 10:26:35 GMT

How to perform such trick with java tFilterRow?

Re: Commit every... with existing connection

_AnonymousUser — Thu, 01 Dec 2011 14:00:50 GMT

Hi,
In tFilterRow, Advanced:
Numeric.sequence("abcd", 1, 1) % 500 == 0
Kind regards,
Yves

Re: Commit every... with existing connection

Anonymous — Fri, 02 Dec 2011 04:23:40 GMT

Numeric.sequence("abcd", 1, 1) % 500 == 0

It works.
Thank you very much!

Re: Commit every... with existing connection

Anonymous — Wed, 21 Mar 2012 08:45:45 GMT

what is "abcd"?

Re: Commit every... with existing connection

janhess — Wed, 21 Mar 2012 09:07:10 GMT

The first 4 letters of the alphabet.
Actually it's the sequence reference name.

Re: Commit every... with existing connection

Anonymous — Fri, 27 Jul 2018 11:51:22 GMT

Hi guys,

Could you please help me with this??

I have 495 records in input when I try to run the job it inserts only 400 records if i keep the expression

Numeric.Sequence("S1",1,1)%100==0 in advanced mode of tFilterRow.

SELECT COUNT(1) FROM TEMP ---> 400

May I know why and how to insert the other 95 records?

PFA screenshot for reference

Thanks in advance

1.PNG

Re: Commit every... with existing connection

Anonymous — Tue, 18 Sep 2018 21:21:22 GMT

Hi Kiran,

Did you find the solution for

"I have 495 records in input when I try to run the job it inserts only 400 records if i keep the expression

Numeric.Sequence("S1",1,1)%100==0 in advanced mode of tFilterRow."

Even I am facing the same issue, If you find the solution please share.

Thank You