Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us to spark ideas for how to put the latest capabilities into action. Register here!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Run Big Data Batch Jobs Dynamically

Hello,

I am trying to use trunjob component to dynamically run jobs whose names will be passed on in iterations. In the trunjob component settings, while I pass on the variable in "Context", I also have to select the jobs whose names would be potentially passed in the variables in the "Job" (Please correct me if I am wrong) . When I try to select the jobs, I only see the standard jobs and not the big data batch jobs, thus, making it impossible for me to run the jobs in a dynamic fashion. I am using Talend 6. 3. 

Is it possible to run the bigdata batch jobs dynamically in this, or any other way?

 

One solution I could think of is creating a standard job that calls the respective big data batch job and then dynamically running those standard jobs.

 

Has anyone implemented this or can anyone think of a cleaner approach?

 

Many thanks.

Labels (3)
1 Reply
Anonymous
Not applicable
Author

Hello,

Could you please let us know if this article is what you are looking for?

https://community.talend.com/t5/Architecture-Best-Practices-and/Spark-Dynamic-Context/ta-p/33038

Best regards

Sabrina