Error while trying to connect Hive using thiveconnection component

Anonymous — Sat, 16 Nov 2024 08:17:47 GMT

Hi,

Can anyone help me in trying to fix the below issue.

I have created a job to connect hive server and fetch a hive table

thiveConnection->thiveInput->tmap(performing data validation chk)->:tlogrow

While compiling itself im facing issue in thive connection.

There is no error msg displayed in run prompt

when i open the code , i could see

"url_thiveConnection_2 cannot be resolved to a variable"

Can anyone plz help me as i am new to talend.

thanks,

Aarthi T

Re: Error while trying to connect Hive using thiveconnection component

Anonymous — Wed, 09 May 2018 08:14:41 GMT

Hello,

Is there any double quote missing around your connection parameter? Screenshots of your job setting will be helpful for us to address your issue quickly.

Best regards

Sabrina

Re: Error while trying to connect Hive using thiveconnection component

Anonymous — Wed, 09 May 2018 09:27:08 GMT

Hi Sabrina,

Please find the screenshot of hiveconnection component.As I am new to Big Data and hive, i am not able to figure it out where the exact problem is. The error which i have mentioned in the below mail chain raised when i kept the connection mode as "Embedded"

When i changed the connection mode to "Standard" , i got different error.

Please find below,

[statistics] connecting to socket on port 3363
[statistics] connected
[ERROR]: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:379)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:394)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:387)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80)
at org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:611)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:273)
at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:261)
at org.apache.hadoop.security.UserGroupInformation.isAuthenticationMethodEnabled(UserGroupInformation.java:338)
at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:332)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.tHiveConnection_1Process(job_hdfs_to_hive.java:602)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.runJobInTOS(job_hdfs_to_hive.java:2876)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.main(job_hdfs_to_hive.java:2707)
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in component tHiveConnection_1 (job_hdfs_to_hive)
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://ip-10-0-4-221.bayerpoc.com:10002/CYRUS;: java.net.UnknownHostException: ip-10-0-4-221.bayerpoc.com
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:224)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.tHiveConnection_1Process(job_hdfs_to_hive.java:656)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.runJobInTOS(job_hdfs_to_hive.java:2876)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.main(job_hdfs_to_hive.java:2707)
Caused by: org.apache.thrift.transport.TTransportException: java.net.UnknownHostException: ip-10-0-4-221.bayerpoc.com
at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:311)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:196)
... 6 more
Caused by: java.net.UnknownHostException: ip-10-0-4-221.bayerpoc.com
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at org.apache.thrift.transport.TSocket.open(TSocket.java:221)
... 10 more
[WARN ]: org.apache.hive.jdbc.HiveConnection - Failed to connect to ip-10-0-4-221.bayerpoc.com:10002
[statistics] disconnected

Suggest which connection mode i need to set.

Thanks,

Aarthi

hive1.PNG

topic Error while trying to connect Hive using thiveconnection component in Talend Studio

Error while trying to connect Hive using thiveconnection component

Re: Error while trying to connect Hive using thiveconnection component

Re: Error while trying to connect Hive using thiveconnection component

Re: Error while trying to connect Hive using thiveconnection component