Run Big Data Batch Jobs Dynamically

Anonymous — Sat, 16 Nov 2024 07:41:51 GMT

Hello,

I am trying to use trunjob component to dynamically run jobs whose names will be passed on in iterations. In the trunjob component settings, while I pass on the variable in "Context", I also have to select the jobs whose names would be potentially passed in the variables in the "Job" (Please correct me if I am wrong) . When I try to select the jobs, I only see the standard jobs and not the big data batch jobs, thus, making it impossible for me to run the jobs in a dynamic fashion. I am using Talend 6. 3.

Is it possible to run the bigdata batch jobs dynamically in this, or any other way?

One solution I could think of is creating a standard job that calls the respective big data batch job and then dynamically running those standard jobs.

Has anyone implemented this or can anyone think of a cleaner approach?

Many thanks.

Re: Run Big Data Batch Jobs Dynamically

Anonymous — Tue, 11 Sep 2018 10:25:50 GMT

Hello,

Could you please let us know if this article is what you are looking for?

https://community.talend.com/t5/Architecture-Best-Practices-and/Spark-Dynamic-Context/ta-p/33038

Best regards

Sabrina

topic Run Big Data Batch Jobs Dynamically in Talend Studio

Run Big Data Batch Jobs Dynamically

Re: Run Big Data Batch Jobs Dynamically