Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Want to see what's currently in public preview? We've pulled it all together in one place. Check it out here
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Hive can't work with using keytab

Hi all,

  I got a issue with Hive connection using kerberos and keytab.I download the hadoop cluster infomations with CM and then config the Hive information, these two configrations are both checked successful. When I drop a tHiveconnection component with using the repository  in a standard job , I run the job but it goes wrong,and the log:

 

[statistics] connecting to socket on port 3334
[statistics] connected
[WARN ]: org.apache.hadoop.util.Shell - Did not find winutils.exe: java.io.FileNotFoundException: java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset. -see https://wiki.apache.org/hadoop/WindowsProblems
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[ERROR]: org.apache.hive.jdbc.HiveConnection - Error opening session
org.apache.thrift.TApplicationException: Required field 'client_protocol' is unset! Struct:TOpenSessionReq(client_protocol:null, configuration:{use:database=datalake_gluetechnology})
 at org.apache.thrift.TApplicationException.read(TApplicationException.java:111)
 at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:79)
 at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_OpenSession(TCLIService.java:168)
 at org.apache.hive.service.rpc.thrift.TCLIService$Client.OpenSession(TCLIService.java:155)
 at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:576)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:186)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at demo.copy_of_test_0_1.Copy_of_test.tHiveConnection_1Process(Copy_of_test.java:657)
 at demo.copy_of_test_0_1.Copy_of_test.runJobInTOS(Copy_of_test.java:1230)
 at demo.copy_of_test_0_1.Copy_of_test.main(Copy_of_test.java:951)
[WARN ]: org.apache.hive.jdbc.HiveConnection - Failed to connect to scdca0000322.cn.isn.corpintra.net:10001
[ERROR]: org.apache.hive.jdbc.Utils - Unable to read HiveServer2 configs from ZooKeeper
Exception in component tHiveConnection_1 (Copy_of_test)
java.sql.SQLException: Could not open client transport for any of the Server URI's in ZooKeeper: Could not establish connection to 

 

I searched some messages from websites, it looks like the JDBC mismatchs the client from the server. I checked both of them are hive-jdbc-1.2.0.It is also a issue that I don't know how to uninstall the external modules in the talend.

Labels (4)
1 Reply
Anonymous
Not applicable
Author

Hello,

Can you please clarify in which Talend version/edition you are?  What's hive version you are connecting to? The connection to Hive fails.

Here is a related topic about "Uninstall-an-external-jar".

Let us know if it is OK with you.

Best regards

Sabrina