topic Re: wait for multiple subjobs to finish before continuing in Talend Studio

wait for multiple subjobs to finish before continuing

Anonymous — Tue, 17 Jul 2012 20:11:02 GMT

Hi,
I have a job that contains several subjobs that unload data from database. It also contains another subjob that will process these data in flat files. Before the processing starts, it has to wait for data unloading to finish. What can I do to make sure that all data unloading have been finished before the processing subjob starts?

Re: wait for multiple subjobs to finish before continuing

Anonymous — Tue, 17 Jul 2012 20:24:47 GMT

There's a component in the enterprise version of of TOS that does this - tParallelize. I don't think there's anything similar in open source TOS, so I think you would have to run the unloading subjobs in sequence, rather than in parallel, to ensure that all are complete before moving to the next operation.

Re: wait for multiple subjobs to finish before continuing

alevy — Wed, 18 Jul 2012 01:21:59 GMT

You can also put the unloading subjobs into one job that is set for multi-thread execution (see Job/Extra tab) and then call that job in another job using a tRunJob linked with OnSubjobOK to the processing subjob.

Re: wait for multiple subjobs to finish before continuing

Anonymous — Wed, 18 Jul 2012 15:04:34 GMT

Thanks, will try that out. Alternatively, I did a bunch of onComponentOk and it seems to work fine.

Re: wait for multiple subjobs to finish before continuing

alevy — Thu, 19 Jul 2012 00:15:58 GMT

OnSubjobOKs would probably be better but, yes, that will work although you lose the ability to parallellise the unloading.

Re: wait for multiple subjobs to finish before continuing

Anonymous — Tue, 24 Jun 2014 05:00:33 GMT

i was getting such figures 0000000-4538795 in my output what can i do on talend to have the negative before zero? -00000004538795

Re: wait for multiple subjobs to finish before continuing

Anonymous — Tue, 24 Jun 2014 06:25:25 GMT

Hi wilsonotieno46,
is this a string value?
If it is a string value, then you can do string handling, use EReplace to remove "-" and then concatenate "-" with the existing string after replacement...
Vaibhav

Re: wait for multiple subjobs to finish before continuing

Anonymous — Tue, 22 Mar 2016 18:25:31 GMT

You can also try a tPostJob. It will run a final subjob after all other components are complete.
Documentation: