Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us to spark ideas for how to put the latest capabilities into action. Register here!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How can to run Big data jobs or Spark Jobs?

I have few basic question on the execution of Big data jobs 
- Does the Talend Big data jobs need to be directly run on Hadoop cluster or can be triggered from other servers ?
-Can the Big data jobs be triggered through TAC ?
-If we generate the jars can the jobs be triggered through talend execution server ?
- If we are using a 3rd party scheduler like control-m how can we schedule the Talend Big data jobs?
Regards
Nishant
Labels (2)
1 Reply
Anonymous
Not applicable
Author

Hi,
Does the Talend Big data jobs need to be directly run on Hadoop cluster or can be triggered from other servers ?

What does your current bigdata job look like? Are you using tHDFSxxx component in your work flow?
Can the Big data jobs be triggered through TAC ?

Talend Administration Center  is a web-based application delivered with the Job Conductor , Big Data Streaming Conductor and ESB Conductor  module s .
Please refer to document about:TalendHelpCenter:Executing Jobs Routes and Services
If we are using a 3rd party scheduler like control-m how can we schedule the Talend Big data jobs

 You can export the job script, and then schedule it with third scheduler tool.
Here is document about:TalendHelpCenter:How to build Jobs
Best regards
Sabrina