[resolved] Talend Open Studio and Hadoop Sandbox from Hortonworks
Hi
I have downloaded Talend Open studio and installed it on windows 7 64 bit. I have also installed the hadoop sandbox from hortonworks.
Created a Hadoop cluster pointing to Hadoop sandbox successfully, but when i create a job and exceute i get errors. I am able to browse hadoop files from the sanbox into talend open studio
Below is the error message
Starting job Pig_Test at 17:35 15/08/2016.
connecting to socket on port 3663
connected
: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:367)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:382)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:375)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
at org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:639)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:272)
at org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:311)
at bd_demo.pig_test_0_1.Pig_Test.tHDFSInput_1Process(Pig_Test.java:551)
at bd_demo.pig_test_0_1.Pig_Test.runJobInTOS(Pig_Test.java:1027)
at bd_demo.pig_test_0_1.Pig_Test.main(Pig_Test.java:884)
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in component tHDFSInput_1
java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:101)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:622)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
at org.apache.hadoop.hdfs.DFSClient.newConnectedPeer(DFSClient.java:3454)
at org.apache.hadoop.hdfs.BlockReaderFactory.nextTcpPeer(BlockReaderFactory.java:777)
at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:694)
at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:355)
at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:618)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:844)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:896)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
disconnected
at java.io.PushbackInputStream.read(PushbackInputStream.java:186)
at org.talend.fileprocess.UnicodeReader.<init>(UnicodeReader.java:25)
at org.talend.fileprocess.TOSDelimitedReader.<init>(TOSDelimitedReader.java:77)
at org.talend.fileprocess.FileInputDelimited.<init>(FileInputDelimited.java:93)
at bd_demo.pig_test_0_1.Pig_Test.tHDFSInput_1Process(Pig_Test.java:659)
at bd_demo.pig_test_0_1.Pig_Test.runJobInTOS(Pig_Test.java:1027)
at bd_demo.pig_test_0_1.Pig_Test.main(Pig_Test.java:884)
Job Pig_Test ended at 17:36 15/08/2016.
Hi xdshi,
I'm not sure how this is makred as resolved. But I'm still facing the issue.
It would be great if you could help me out with this.
Regards.
Mitul Vyas
