topic Connecting to Hive in HA Cluster / Unknown Host Error in Talend Studio

Connecting to Hive in HA Cluster / Unknown Host Error

Anonymous — Sat, 16 Nov 2024 11:17:32 GMT

I'm attempting to setup a very simple Hive Query to a Hortonworks HDP 2.2 cluster that is HA aware.
After following this KB topic -> https://help.talend.com/search/all?query=Enabling%252Bthe%252BHDFS%252BHigh%252BAvailability%252Bfeature%252Bin%252Bthe%252BStudio
I am getting an unknown host error even after configuring HA as described in the article.

: org.apache.hadoop.hive.ql.exec.Utilities - Processing alias <topic>
: org.apache.hadoop.hive.ql.exec.Utilities - Adding input file hdfs://clustername/<some_directory>/<topic>/day=2015-02-09/time=00-00
: org.apache.hadoop.hive.ql.exec.Utilities - Content Summary not cached for hdfs://clustername/<some_directory>/<topic>/day=2015-02-09/time=00-00
java.lang.IllegalArgumentException: java.net.UnknownHostException: clustername
at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:418)
at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:231)
I'm leveraging Talend Big Data 5.6 on Win 7. Everything seems normal before this - the flow connects to hcat (for metadata) and hdfs (for temp directory) fine... the flow bombs when hive gives back the cluster name vs one of the name nodes.

Re: Connecting to Hive in HA Cluster / Unknown Host Error

Anonymous — Wed, 01 Apr 2015 09:38:27 GMT

Hi,
What's your c onnection mode to Hive? Could you please also show us screenshots of the Basic settings tab of HIVE connection component?

Best regards
Sabrina

Re: Connecting to Hive in HA Cluster / Unknown Host Error

Anonymous — Tue, 29 Sep 2015 03:36:23 GMT

The connection mode was Embedded. I was able to get the flow to work properly by switching to Standalone and Hive 2. This doesn't necessarily directly solve the HA question, but it works.

Re: Connecting to Hive in HA Cluster / Unknown Host Error

willm1 — Thu, 03 Dec 2015 19:42:54 GMT

I'm sure you already figured this out - else, here's a post on Hive HA.