Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello,
I am trying to use trunjob component to dynamically run jobs whose names will be passed on in iterations. In the trunjob component settings, while I pass on the variable in "Context", I also have to select the jobs whose names would be potentially passed in the variables in the "Job" (Please correct me if I am wrong) . When I try to select the jobs, I only see the standard jobs and not the big data batch jobs, thus, making it impossible for me to run the jobs in a dynamic fashion. I am using Talend 6. 3.
Is it possible to run the bigdata batch jobs dynamically in this, or any other way?
One solution I could think of is creating a standard job that calls the respective big data batch job and then dynamically running those standard jobs.
Has anyone implemented this or can anyone think of a cleaner approach?
Many thanks.
Hello,
Could you please let us know if this article is what you are looking for?
https://community.talend.com/t5/Architecture-Best-Practices-and/Spark-Dynamic-Context/ta-p/33038
Best regards
Sabrina