topic Re: Capture 1st rejected record and stop the job without processing anymore records in Talend Studio

Capture 1st rejected record and stop the job without processing anymore records

borrisbeck — Thu, 21 Dec 2017 14:58:24 GMT

Hi
I'm loading millions of records in to a oracle table using tOracleoutput component. while loading if for any reason a record gets rejected,
Is it possible to capture that record and stop the job.

I tired disabling the batch process and added a reject link to the toracleoutput and also added a "if trigger" link with condition "((Integer)globalMap.get("tOracleOutput_1_NB_LINE_REJECTED"))> 0".I'm able to get the rejected records, but the job is not stopping until it process all the records.

is there anyway to stop the job without processing all the records?

Re: Capture 1st rejected record and stop the job without processing anymore records

TRF — Thu, 21 Dec 2017 15:06:30 GMT

Hi,

What if you connect your reject flow on the tDie component?

Re: Capture 1st rejected record and stop the job without processing anymore records

borrisbeck — Thu, 21 Dec 2017 15:13:24 GMT

Tried that as well, the job is not stopping until it finished processing all the records.

Re: Capture 1st rejected record and stop the job without processing anymore records

TRF — Thu, 21 Dec 2017 15:20:38 GMT

Then you probably have to reduce the "Batch Size" parameter to 1.

Have a look to this post where I wrote something regarding the same issue for Salesforce component.

Re: Capture 1st rejected record and stop the job without processing anymore records

borrisbeck — Thu, 21 Dec 2017 16:04:25 GMT

I have a doubt implementing your design, If I enable the "Use Batch SIze" in advanced setting, I can't have a reject link and its the same if I enable "Die on error" as well in tOracleoutput. So how to capture the rejected records and at the same time stop the job without processing anymore records?

Re: Capture 1st rejected record and stop the job without processing anymore records

borrisbeck — Fri, 22 Dec 2017 17:19:30 GMT

Hi, Can anybody provide some insights on this pls?

Re: Capture 1st rejected record and stop the job without processing anymore records

Anonymous — Mon, 25 Dec 2017 06:54:12 GMT

Hello,

Does your "RunIf" condition work well in your work flow?

Best regards

Sabrina

Re: Capture 1st rejected record and stop the job without processing anymore records

borrisbeck — Tue, 26 Dec 2017 13:51:49 GMT

As i said earlier, even with the "If Trigger/Condition", the job is not stopping right away the moment it gets the first reject, its still processing all the records.

Re: Capture 1st rejected record and stop the job without processing anymore records

Anonymous — Wed, 27 Dec 2017 06:14:34 GMT

Hello,

@ris.tan wrote:

As i said earlier, even with the "If Trigger/Condition", the job is not stopping right away the moment it gets the first reject, its still processing all the records.

We suppose that your "RunIf" condition is not triggered successfully.

Best regards

Sabrina

Re: Capture 1st rejected record and stop the job without processing anymore records

borrisbeck — Tue, 02 Jan 2018 14:40:54 GMT

Thanks for responding, this is the condition i'm using in the "If trigger", please let me know what is wrong

"((Integer)globalMap.get("tOracleOutput_1_NB_LINE_REJECTED"))> 0"