topic Re: [resolved] hive-site.xml not found on CLASSPATH in Talend Studio

[resolved] hive-site.xml not found on CLASSPATH

Anonymous — Sat, 16 Nov 2024 12:11:38 GMT

Hi,
I use Talend 5.1 et and i have a Hive connection but i got a message error concerning the hive_site.xml

démarrage du job job_connect_2 a 15:03 13/09/2012.
connecting to socket on port 3977
connected
12/09/13 15:03:36 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
12/09/13 15:03:36 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation classrg.apache.hadoop.hive.metastore.ObjectStore
12/09/13 15:03:36 INFO metastore.ObjectStore: ObjectStore, initialize called
12/09/13 15:03:36 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
12/09/13 15:03:36 INFO DataNucleus.Persistence: Property javax.jdo.option.NonTransactionalRead unknown - will be ignored
12/09/13 15:03:36 INFO DataNucleus.Persistence: ================= Persistence Configuration ===============
12/09/13 15:03:36 INFO DataNucleus.Persistence: DataNucleus Persistence Factory - Vendor: "DataNucleus" Version: "2.0.3"
12/09/13 15:03:36 INFO DataNucleus.Persistence: DataNucleus Persistence Factory initialised for datastore URL="jdbc:derby:;databaseName=metastore_db;create=true" driver="org.apache.derby.jdbc.EmbeddedDriver" userName="APP"
12/09/13 15:03:36 INFO DataNucleus.Persistence:

Could you please tell me in which directory i must put the hive_site.xml and how to configure it ?

Thanks

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Sat, 15 Sep 2012 07:38:49 GMT

Hi
It is an issue of hive, see
https://issues.apache.org/jira/browse/HIVE-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 18 Sep 2012 09:54:25 GMT

Hi,
It is still an issue, i got someone from Talend in France, he told me to put the file hive-site.xml in the directory :
C:\TALEND_FOR_BIG_DATA\TOS_BD-r84309-V5.1.1\lib or C:\TALEND_FOR_BIG_DATA\TOS_BD-r84309-V5.1.1\lib\java
but the issue still exists.
I downloaded the Talend version 5.2 but i can't connect to hive.

If you have any solution for this issue , i will appreciate.

Thanks.

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Sun, 18 Nov 2012 11:33:51 GMT

Hello,
You don't need to put a Hive site in the classpath. Actually, at runtime, Hive requires this file to be in the classpath but it's not mandatory. All the needed properties are overriden by the Talend components.
What is your error/problem? It's gonna be helpful to help you.
Rémy.

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Thu, 18 Apr 2013 14:21:11 GMT

Hi all,
did you find the solution? i get the same error message!
thanks.

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 29 Oct 2013 10:30:55 GMT

I am also getting the same error..Is there any solution for this?
13/10/29 12:14:10 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
13/10/29 12:14:11 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation class rg.apache.hadoop.hive.metastore.ObjectStore
13/10/29 12:14:11 INFO metastore.ObjectStore: ObjectStore, initialize called
13/10/29 12:14:11 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
13/10/29 12:14:11 INFO DataNucleus.Persistence: Property javax.jdo.option.NonTransactionalRead unknown - will be ignored
13/10/29 12:14:11 INFO DataNucleus.Persistence: ================= Persistence Configuration ===============
13/10/29 12:14:11 INFO DataNucleus.Persistence: DataNucleus Persistence Factory - Vendor: "DataNucleus" Version: "2.0.3"
13/10/29 12:14:11 INFO DataNucleus.Persistence: DataNucleus Persistence Factory initialised for datastore URL="jdbc:derby:;databaseName=metastore_db;create=true" driver="org.apache.derby.jdbc.EmbeddedDriver" userName="APP"
13/10/29 12:14:11 INFO DataNucleus.Persistence: ===========================================================
13/10/29 12:14:12 INFO Datastore.Schema: Initialising Catalog "", Schema "APP" using "None" auto-start option
etc....

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 29 Oct 2013 10:40:06 GMT

Hi,
It is just a warning. It's not an error and this missing file doesn't matter. Everything is supposed to be set up in the generated code. If you have an error, please attach the real problem.
Cheers,
Rémy.

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 29 Oct 2013 11:34:47 GMT

Sending the complete error message..
13/10/29 12:14:10 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
13/10/29 12:14:11 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation class rg.apache.hadoop.hive.metastore.ObjectStore
13/10/29 12:14:11 INFO metastore.ObjectStore: ObjectStore, initialize called
13/10/29 12:14:11 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
13/10/29 12:14:11 INFO DataNucleus.Persistence: Property javax.jdo.option.NonTransactionalRead unknown - will be ignored
13/10/29 12:14:11 INFO DataNucleus.Persistence: ================= Persistence Configuration =============== 13/10/29 12:14:11 INF

To see the whole post, download it here
OriginalPost.pdf

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 29 Oct 2013 13:47:59 GMT

Hi,
It seems the folder /tmp doesn?t exist in HDFS.
Can you please confirm using:
- hadoop fs -ls /
If you confirm, please create the directory and set up the correct permissions:
- su hdfs
- hadoop fs -mkdir /tmp
- hadoop fs -chmod -R 777 /tmp

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Wed, 30 Oct 2013 12:59:43 GMT

The error message still exists after changing the folder permission.
Here is the ls result..

:/usr/local/hadoop$ hadoop fs -ls /
Warning: $HADOOP_HOME is deprecated.
Found 5 items
drwxr-xr-x - ciber supergroup 0 2013-09-25 18:02 /app
drwxr-xr-x - ciber supergroup 0 2013-10-28 20:09 /home
drwxr-xr-x - ciber supergroup 0 2013-09-27 17:58 /system
drwxrwxrwx - ciber supergroup 0 2013-10-30 20:56 /tmp
drwxr-xr-x - ciber supergroup 0 2013-10-28 20:18 /user

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Thu, 31 Oct 2013 09:35:15 GMT

Hi,
Is your studio located on Windows? If this is the case, could you please confirm you have a "tmp" folder created in C:/ ?
Cheers,
Rémy.

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 05 Nov 2013 08:59:25 GMT

Hi Remy,
I am getting the same error after creating a folder /tmp/hadoop under "C" drive..Here is the error..

Starting job Hive_connect at 14:26 05/11/2013.

connecting to socket on port 3743
connected
13/11/05 14:26:02 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
13/11/05 14:26:02 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation class rg.apache.hadoop.hive.metastore.ObjectStore
13/11/05 14:26:02 INFO metastore.ObjectStore: ObjectStore, initialize called
13/11/05 14:26:03 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored 13/11/05 14:26:03 INFO DataNucleus.Persistence: Proper

To see the whole post, download it here
OriginalPost.pdf

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 05 Nov 2013 10:04:50 GMT

What's your hadoop distribution?

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 05 Nov 2013 10:32:48 GMT

I am using Apache stack.

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 05 Nov 2013 10:40:20 GMT

What did you select as the distribution in the talend component?

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Tue, 05 Nov 2013 12:26:19 GMT

As i showed my screenshot, i had selected "Apache" as distribution and Hive version as "Apache 1.0.0 (Hive 0.9.0).

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Thu, 07 Nov 2013 09:52:26 GMT

Could you please confirm the "Connection Mode"? As of now, i am using "Embedded" mode.

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Fri, 08 Nov 2013 09:15:56 GMT

Hi,
Embedded is good. Nevertheless, it would be gret you to confirm that the metastore is started on the port 9083.
What is the output of the command (to be launched on the namenode machine): netstat -ntlup | grep :9083

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Fri, 22 Nov 2013 11:01:01 GMT

Finally i found the solution for this issue. Though it is very simple, i took a long time to find out.
1. Please make sure about port -> it should be 10000 for standalone mode
2. Start Hive Thrift Server by entering "hive --service hiveserver"
Also check in http://raj-hadoop.blogspot.in/2013/11/talend-open-studio-warn-confhiveconf.html
Thats it! you can play around Talend now!

Re: [resolved] hive-site.xml not found on CLASSPATH

Anonymous — Mon, 25 Nov 2013 09:44:05 GMT

Standalone = 10000
Embedded = 9083
There are default ports. Need to make sure this is the same for your clusters.