topic Re: thiveInput throws error on MR job in Talend Studio

thiveInput throws error on MR job

Anonymous — Wed, 14 May 2014 21:12:59 GMT

Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
I an getting above when in run a MR job using thiveInput but the same query works fine in hive shell.
Sample query: select last_name from hivetest.users;
But the query select * works fine without an issues.
Is this any permission issue or configuration issue?
Thanks,
Anand.

Re: thiveInput throws error on MR job

Anonymous — Thu, 15 May 2014 05:57:51 GMT

Hi,
Could you tell us the build version are you using? What's your OS and JDK version? Did this studio work well before?
Best regards
Sabrina

Re: thiveInput throws error on MR job

Anonymous — Thu, 15 May 2014 17:57:44 GMT

Java Version: java version "1.6.0_65"
Max OS X 10.9.2
Talend EnterPrise Big Data V5.4.1.r111943
This is the first time i am running the MR job in the tHIveInput, and Talend studio works fine for queries that are not MR jobs as I mentioned in the previous post.
Thanks,
Anand.

Re: thiveInput throws error on MR job

Anonymous — Fri, 16 May 2014 07:37:22 GMT

Hi,
What's your Hadoop version? Did you set YARN classpath in Hadoop?
Best regards
Sabrina

Re: thiveInput throws error on MR job

Anonymous — Fri, 16 May 2014 17:41:30 GMT

Hortonworks 2.1
Here is the property in yarn-site.xml
<property>
<name>yarn.application.classpath</name>
<value>/etc/hadoop/conf,/usr/lib/hadoop/*,/usr/lib/hadoop/lib/*,/usr/lib/hadoop-hdfs/*,/usr/lib/hadoop-hdfs/lib/*,/usr/lib/hadoop-yarn/*,/usr/lib/hadoop-yarn/lib/*,/usr/lib/hadoop-mapreduce/*,/usr/lib/hadoop-mapreduce/lib/*</value>
</property>
~Anand.

Re: thiveInput throws error on MR job

Anonymous — Mon, 19 May 2014 08:07:49 GMT

Hi,
Hortonworks 2.1 is supported in talend v 5.5.0.
https://jira.talendforge.org/browse/TDI-28751.
Please refer to the Talend Open Studio for Big Data Installation and Upgrade Guide 54 TalendHelpCenterupported systems and databases.
Best regards
Sabrina

Re: thiveInput throws error on MR job

Anonymous — Mon, 19 May 2014 17:44:43 GMT

Do you know when talend v 5.5.0 will be available?
Thanks,
Anand.

Re: thiveInput throws error on MR job

Anonymous — Mon, 19 May 2014 19:43:39 GMT

Thanks Sabrina.
I tested with Hortonworks V 2.0 and everything works fine.

Re: thiveInput throws error on MR job

Anonymous — Tue, 20 May 2014 05:04:08 GMT

Hi,
Our next release is scheduled for May / June.( talend open source 5.5.0/talend enterprise subscription 5.4.2).

I tested with Hortonworks V 2.0 and everything works fine.

Thanks for your feedback. It's helpful for us.
Best regards
Sabrina

Re: thiveInput throws error on MR job

Anonymous — Wed, 28 May 2014 09:09:09 GMT

Hi anandajothim,
Talend Open Studio's 5.5.0 release is available
Please refer to Announcement forum https://community.talend.com/t5/Archive/Talend-Open-Studio-s-5-5-0-release-is-available/td-p/196092.
Best regards
Sabrina