Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Currently I am trying to push and store data in Hive using Talend. My idea is to upload data to hdfs, then execute hive ql to load the data into Hive. Ideally in talend, the workflow would be:
**some activities to process the data > tMap > tHDFS_Put > tHiveCreateTable > tHiveLoad.
In order to use any hdfs and hive components, I'll have first need to configure the hadoop cluster in the talend. So, I created under Metadata repo in Talend :
In the area for the manager credentials, I put the authentication information to login the Web-based management service of the cluster (CM).
However, I still get the connection failed error.
The next effort i tried was trying to just use the tHdfsConnection and tHiveConnection in the Standard Job.
tHdfsConnection:
This component received : [WARN ] 09:26:15 org.apache.hadoop.util.NativeCodeLoader- Unable to load native-hadoop library for your platform... using builtin-java classes where applicable.
tHiveConnection:
This component received following error as in the attachment (Zookeeper error).
My questions:
Reference:
Hi,
Thank you for writing to us.
zookeeper-3.4.14.jar
zookeeper-jute-3.7.0.jar
Regards,
How do you load data into Hive external table?