topic Re: Scenario based Question in Talend??? in Talend Studio

Scenario based Question in Talend???

Prasanna3 — Wed, 12 Sep 2018 09:15:40 GMT

How can I stop a job after 3 failures in talend?

Re: Scenario based Question in Talend???

fdenis — Wed, 12 Sep 2018 09:24:57 GMT

add an other job who call your job using 3 tRunJob and link tRunJob by onComponentError.

It's Done.
Regards

Re: Scenario based Question in Talend???

Prasanna3 — Wed, 12 Sep 2018 09:30:27 GMT

Can you please provide me complete job design ?

Re: Scenario based Question in Talend???

fdenis — Wed, 12 Sep 2018 10:05:13 GMT

it is complete.
create a new job.
slide jour job inside 3times. (it will add 3 trunJob components)
link your 3 trunjob using onComponentError
Regards,

Re: Scenario based Question in Talend???

Jesperrekuh — Wed, 12 Sep 2018 14:04:13 GMT

Isn't 1 failure just enough? Except time outs ... File not there yet ... kinda time-based related things.

But 3 Is just planning for more failure and is 'bad' design. 3 sounds arbitraty, why not 4 or 5 ... I dont get this type of reasoning. Why please elaborate?

Possible solution:

OnComponentError / OnSubJobError ----> tJava

// check if exists
Integer  cnt =(Integer) globalMap.get("error_counter");
if cnt != null {
cnt ++; 
globalMap.put("error_counter", cnt );
if cnt.equals(3)  { 
// raise exception to make sure it dies...
  throw new Exception(); 
  }
}else { globalMap.put("error_counter", 1 ) ; }

after tJava a tDie/tWarn component to do whatever you want to do ...

Re: Scenario based Question in Talend???

Prasanna3 — Wed, 12 Sep 2018 14:20:05 GMT

My question is.

I want to kill the job after 3 times failed.
Can I implement that without writing tjava code

Re: Scenario based Question in Talend???

Jesperrekuh — Wed, 12 Sep 2018 14:35:36 GMT

Yes but its very inefficient like :
tRunJob --> OnComponentError -->tRunJob --> OnComponentError -->tRunJob --> OnComponentError --> tDie
This is what @fdenis is suggesting but doesnt take into account a specific component where you want to set a limit of errors.

There should be some sort of error count within Talend ... and within tDie and tWarn ... die after max threshold