Skip to main content
Announcements
SYSTEM MAINTENANCE: Thurs., Sept. 19, 1 AM ET, Platform will be unavailable for approx. 60 minutes.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Run multiple subjobs/jobs in series

Hi All experts,

I have multiple flat files which I have to load in different Oracle tables. I can create one job/subjob for each file. However, each load should run in a series. I need to design the whole flow such that even if any intermediate loading fails the next load should continue as is after logging an error. Can someone help?
Labels (4)
3 Replies
David_Beaty
Specialist
Specialist

Hi,

 

First of all, are you using the Open or Enterprise version of Talend?

 

Enterprise - use the tParallelize component

Open - Create a wrapper job that invokes child-jobs for each flat file but dont link them together with the "OnSubJobOK" link. Ensure this wrapper job has the "Job-Extra" parameter of "Multi thread execution" ticked.

 

As with all multi-threaded executions, you should question whether all touch points of your ETL are actually up to the job of you loading multiple flat files to Oracle simultaneously.

 

Thanks

 

Anonymous
Not applicable
Author

I am using talend DI community edition.
David_Beaty
Specialist
Specialist

OK, then you should follow the information for the "Open" section I described.