Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Write Table now available in Qlik Cloud Analytics: Read Blog
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Run Big Data Batch Jobs Dynamically

Hello,

I am trying to use trunjob component to dynamically run jobs whose names will be passed on in iterations. In the trunjob component settings, while I pass on the variable in "Context", I also have to select the jobs whose names would be potentially passed in the variables in the "Job" (Please correct me if I am wrong) . When I try to select the jobs, I only see the standard jobs and not the big data batch jobs, thus, making it impossible for me to run the jobs in a dynamic fashion. I am using Talend 6. 3. 

Is it possible to run the bigdata batch jobs dynamically in this, or any other way?

 

One solution I could think of is creating a standard job that calls the respective big data batch job and then dynamically running those standard jobs.

 

Has anyone implemented this or can anyone think of a cleaner approach?

 

Many thanks.

Labels (3)
1 Reply
Anonymous
Not applicable
Author

Hello,

Could you please let us know if this article is what you are looking for?

https://community.talend.com/t5/Architecture-Best-Practices-and/Spark-Dynamic-Context/ta-p/33038

Best regards

Sabrina