topic Re: Running a single job multiple times simultaneously at a time. in Talend Studio

Running a single job multiple times simultaneously at a time.

Anonymous — Sat, 16 Nov 2024 03:37:56 GMT

Hello guys,

How to run a single job multiple times simultaneously at a time using different inputs in the same system?

Thanks&Regards

Chandrika.

Re: Running a single job multiple times simultaneously at a time.

fdenis — Thu, 09 Jan 2020 13:20:57 GMT

hi, the simple way is to create a job who iterate calling tRunJob
allowing parallele

read this first:
https://help.talend.com/reader/hAvEdyyJuy8ve5LO7PwFXA/9udHX4pQIyxz3t6Q60Ycpg
goodLuck

Re: Running a single job multiple times simultaneously at a time.

madhukolli2003 — Thu, 09 Jan 2020 14:07:56 GMT

Hi Fdenis,

Can you please post english version link?

Re: Running a single job multiple times simultaneously at a time.

fdenis — Thu, 09 Jan 2020 14:13:38 GMT

https://help.talend.com/reader/1m9g2R1Yu5aRrNIGSXsmTA/vPW5kZBB~nOAJIkLh04m9A

sorry I take the default (for me) one.

Re: Running a single job multiple times simultaneously at a time.

Anonymous — Mon, 13 Jan 2020 11:31:40 GMT

Hi fdenis
Thanks for the reply.
Is there any other alternative without using trunjob component?

Re: Running a single job multiple times simultaneously at a time.

Anonymous — Mon, 13 Jan 2020 12:18:19 GMT

What @fdenis suggested is a good way, but I can understand why it might not work. Can you give a bit more detail as to why you need another method? This might help us identify a more suitable method for you

Re: Running a single job multiple times simultaneously at a time.

Anonymous — Mon, 13 Jan 2020 12:54:12 GMT

Hello rhall_2_0,
I have to run my job multiple times with different input context variables without waiting for the completion of first iteration.

Re: Running a single job multiple times simultaneously at a time.

Anonymous — Mon, 13 Jan 2020 15:53:10 GMT

If you are using the subscription version, this can be done with the TAC or TMC quite easily. Just set up your multiple jobs and configure the contexts for them. If not, you can compile your job and run multiple versions on the command line.

Oh I should mention that if you are using the subscription version you can run several of your jobs in parallel using the method that @fdenis suggested. But you can overdo the parallel processing on one machine if you are not careful.

Re: Running a single job multiple times simultaneously at a time.

Anonymous — Mon, 27 Jan 2020 09:14:09 GMT

Thanks for the response , Could you pl share if TAC or TMC is an addon module to install

I have installed Talend open studio for data integration , couldn't see any tParallel job or details

Some more details will help , thanks

Also looking for subscription version details

Re: Running a single job multiple times simultaneously at a time.

Anonymous — Mon, 27 Jan 2020 13:40:07 GMT

TAC (Talend Administration Center) and TMC (Talend Management Console) are part of the Data Fabric subscription package. Given that you are not using Data Fabric, you will be limited as to how you can do this.

The solution supplied by @fdenis will work, but may need some tweaking with some logic to identify which tRunJobs to run. By that I mean, you will have 4 versions of your job set to run in parallel in your "wrapper job", you will also need to have 4 versions of the context variables to supply to them. If you have 21 instances of the job to be run, for 5 of the "wrapper job" runs will be fine since each of the context variables will be populated with appropriate values, however the "wrapper job" will need to be called again for the 21st instance.

For information on Data Fabric, go to this page and fill in the details for more information....

https://info.talend.com/request_datafabric.html?type=productspage

Re: Running a single job multiple times simultaneously at a time.

Anonymous — Wed, 29 Jan 2020 07:15:55 GMT

Thanks for your reply , Multiple or duplicate jobs is thought of and seems not applicable to our scenario / use-case , technically modifications would multiply too , could be used in a No-Go for us

Thanks for the detailed response again

I have been trying to contact the sales , will do that

Regards

Chandrika