Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

[resolved] Don´t able to connect to HDFS

Hi, I´m folow this tutorial:  to conect to hdfs
I,m using Talend Studio for Big Data v5.6.1 and my hadoop distribution is 2.6.
But I get the follow errors:
Starting job InputDataHDFS at 13:12 08/05/2015.
connecting to socket on port 3979
connected
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 0 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 0 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 1 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 2 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 3 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 4 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 5 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 6 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 7 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 8 time(s).
: org.apache.hadoop.ipc.Client - Retrying connect to server: 192.168.56.101/192.168.56.101:9000. Already tried 9 time(s).
Exception in component tHDFSOutput_1
java.net.ConnectException: Call to 192.168.56.101/192.168.56.101:9000 failed on connection exception: java.net.ConnectException: Connection refused: no further information
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1095)
at org.apache.hadoop.ipc.Client.call(Client.java:1071)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
: org.apache.hadoop.security.UserGroupInformation - PriviledgedActionException as:hduser cause:java.net.ConnectException: Call to 192.168.56.101/192.168.56.101:9000 failed on connection exception: java.net.ConnectException: Connection refused: no further information
at com.sun.proxy.$Proxy1.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:238)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:203)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:117)
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:115)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:115)
at hadoopconnect.inputdatahdfs_0_1.InputDataHDFS.tRowGenerator_1Process(InputDataHDFS.java:783)
at hadoopconnect.inputdatahdfs_0_1.InputDataHDFS.tHDFSConnection_1Process(InputDataHDFS.java:393)
at hadoopconnect.inputdatahdfs_0_1.InputDataHDFS.runJobInTOS(InputDataHDFS.java:1308)
at hadoopconnect.inputdatahdfs_0_1.InputDataHDFS.main(InputDataHDFS.java:1165)
Caused by: java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:656)
at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:434)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:560)
at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:184)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1202)
at org.apache.hadoop.ipc.Client.call(Client.java:1046)
... 22 more
disconnected
Job InputDataHDFS ended at 13:13 08/05/2015.
Labels (4)
1 Reply
Anonymous
Not applicable
Author

Talend doesn´t support Hadoop 2.6 version.