Not able to schedule big-data jobs(e.g.PIG,HIVE,M/R) using OOZIE

[Anonymous]

Hi,
I am very new to Talend. Is there a way to schedule Hadoop Jobs (e.g. HIVE, PIG etc.) using OOZIE plugin.
Can you please show me a example.
Regards,
Shouvanik

[Anonymous]

Hi,
I am using Talend 5.3.0. And I am able to successfully run a basic Talend Job using OOZIE. It was a problem with namenode and jobtracker port. I have now modified to correct ports.
For this, I tried core-site.xml for namenode and mapred-site.xml for jobtracker endpoints. The issue is now solved.! Thanks
Shouvanik

[Anonymous]

Hi,
Is OOZIE applicable to big data jobs ONLY?
Regards,
Shouvanik

[Anonymous]

Hi,
I am stuck with this
Please check if the "Job tracker end point" and "Oozie end point" are valid!

[Anonymous]

Now, I am getting this weird error. I have a simple job of printing a message.
Deploying job to Hadoop...
Deployment complete!
Job is running ...
Job killed!
Main class , exit code
Job failed, error message, exit code ]

Please help.
I am pasting the job archieve.

[Anonymous]

I am not able to run a job with tMsgBox component. What can be the problem? Its very annoying and frustrating.
Deploying job to Hadoop...
Deployment complete!
Job is running ...
Job killed!
Main class , exit code
Job failed, error message, exit code ]

[Anonymous]

I am sorry. But I don't get reply too often to my queries. Can anyone please reply to my last post.

[Anonymous]

Hi,
I have a flow where I fetch data from MySQL to HDFS using tSqoopImport_1 component. I can see the part files inside HDFS.
Now, I want to load data into HIVE.
I am not able to find a suitable component (Big data) using which to load data.
can you please help? I am using Talend Open Studio 5.3.0.
Regards,
Shouvanik

[Anonymous]

Hi,
Is there any approach to load data directly from MYSQL to HIVE? I saw one component like tSqoopImport but this component only loads data into HDFS. I am using Talend v 5.3
Please help.
Regards,
Shouvanik

[Anonymous]

Hi,
I agree the Oozie logs are not very explicit. You will find additional logs browsing the oozie console and then the jobtracker logs.
Oozie console: http://hostname:11000/oozie
-> Then click on your job which failed.
-> Then browse the logs of this job.
You will be able to find details here.
The error you get gives a clue even though. The local file can't be sent to HDFS. I think about a permission issue.

Regarding the first problem, could you please do that again. Using Oozie, all the interesting logs are on the jobtracker.

[Anonymous]

Regarding your last question, I can help you but please create another thread: 1 question per thread, else it will be hard to follow up.