Connection to HDFS on tHDFSInput takes a long time (HDFS HA)

Anonymous — Sat, 16 Nov 2024 11:29:08 GMT

Hello,
I have a kerberized High Availability HDFS cluster setup and followed the instructions here for setting up my connection to the HA cluster:

When configuring the Authentication settings in a tHDFSInput component after changing to the _HOST value the job ran much slower than when using the fully qualified host name.
Here is the log file from job in question.

< <

To see the whole post, download it here

Re: Connection to HDFS on tHDFSInput takes a long time (HDFS HA)

Anonymous — Sat, 08 Nov 2014 08:59:47 GMT

Hi
There is a KB article about enabling the HDFS High Avaliability feature in the Studio, I hope it can help you.

: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

It is a well-know error, see jlolling's https://community.talend.com/t5/Design-and-Development/Talentd-Big-Data-5-5-1-on-windows-against-cloudera-5-1-2-on/td-p/60128 in this topic.
Best regards
Shong

topic Connection to HDFS on tHDFSInput takes a long time (HDFS HA) in Talend Studio

Connection to HDFS on tHDFSInput takes a long time (HDFS HA)

Re: Connection to HDFS on tHDFSInput takes a long time (HDFS HA)