Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Talend Cloud AWS EU Scheduled Outage: Starting Tues 26 May 21:00 CEST with expected completion Wed 27 May 01:00 CEST
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Parallel tasks Execution on TAC for single Talend reusable job

Hi ,

 

I have  created a common template Talend job which is common for different tables load. I am looking for a work around to execute this template job for multiple tables in parallel. My input will be a table name and template job will take care of loading data.now i want have multi thread concept where i can pass table name for different threads so it can execute all threads parallel and load all tables. For example, I have 20 tables and common job needs to be executed for these 20 tables parallel. My only input for each thread will be a different table name and all thread should execute parallel. Please let me know how to achieve in in TAC?

 

Thanks,

Punnam 

Labels (3)
1 Reply
Anonymous
Not applicable
Author

Hi,

 

You could achieve this by using execution plan in Talend Administrator Center. Your execution plan could have jobs running in Parallel and you could pass the tables names as context parameter. Note that your studio job needs to have the same context parameter names. Another point to note is that you will have to add these jobs in Job conductor.

 

Step1: add the jobs in job conductor

0683p000009Lyeq.jpg

 

Step 2: Create Execution Plan

0683p000009Lyie.jpg

 

Step 3: pass the table name from TAC

0683p000009LyzJ.jpg

 

Thanks,

RekhaSree