Skip to main content
Announcements
Introducing a new Enhanced File Management feature in Qlik Cloud! GET THE DETAILS!
cancel
Showing results for 
Search instead for 
Did you mean: 
BNP
Contributor
Contributor

Unable to read à file with tHDFSInput (HDFS, sanbox vartual box)

hi,

 

I have a problem with talend big data, i try to read a file located int the hdfs with a tHDFSInput and a have this error :

 

Exception in component tHDFSInput_1 (Copy_of_HDFC)
java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Unknown Source)
at sun.nio.ch.SocketChannelImpl.connect(Unknown Source)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
at org.apache.hadoop.hdfs.DFSClient.newConnectedPeer(DFSClient.java:3539)
at org.apache.hadoop.hdfs.BlockReaderFactory.nextTcpPeer(BlockReaderFactory.java:775)
[FATAL]: proj.copy_of_hdfc_0_1.Copy_of_HDFC - tHDFSInput_1 null
java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Unknown Source)
at sun.nio.ch.SocketChannelImpl.connect(Unknown Source)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
at org.apache.hadoop.hdfs.DFSClient.newConnectedPeer(DFSClient.java:3539)
at org.apache.hadoop.hdfs.BlockReaderFactory.nextTcpPeer(BlockReaderFactory.java:775)
at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:692)
at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:355)
at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:652)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:888)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:945)
at java.io.DataInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at java.io.PushbackInputStream.read(Unknown Source)
at org.talend.fileprocess.UnicodeReader.<init>(UnicodeReader.java:25)
at org.talend.fileprocess.TOSDelimitedReader.<init>(TOSDelimitedReader.java:77)
at org.talend.fileprocess.FileInputDelimited.<init>(FileInputDelimited.java:93)
at proj.copy_of_hdfc_0_1.Copy_of_HDFC.tHDFSInput_1Process(Copy_of_HDFC.java:934)
at proj.copy_of_hdfc_0_1.Copy_of_HDFC.tHDFSConnection_1Process(Copy_of_HDFC.java:468)
at proj.copy_of_hdfc_0_1.Copy_of_HDFC.runJobInTOS(Copy_of_HDFC.java:1581)
at proj.copy_of_hdfc_0_1.Copy_of_HDFC.main(Copy_of_HDFC.java:1381)
at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:692)
at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:355)
at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:652)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:888)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:945)
at java.io.DataInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at java.io.PushbackInputStream.read(Unknown Source)
at org.talend.fileprocess.UnicodeReader.<init>(UnicodeReader.java:25)
at org.talend.fileprocess.TOSDelimitedReader.<init>(TOSDelimitedReader.java:77)
at org.talend.fileprocess.FileInputDelimited.<init>(FileInputDelimited.java:93)
at proj.copy_of_hdfc_0_1.Copy_of_HDFC.tHDFSInput_1Process(Copy_of_HDFC.java:934)
at proj.copy_of_hdfc_0_1.Copy_of_HDFC.tHDFSConnection_1Process(Copy_of_HDFC.java:468)
at proj.copy_of_hdfc_0_1.Copy_of_HDFC.runJobInTOS(Copy_of_HDFC.java:1581)
at proj.copy_of_hdfc_0_1.Copy_of_HDFC.main(Copy_of_HDFC.java:1381)
[statistics] disconnected

 

can anyone help me this. Able to connect successfully. 

Labels (2)
0 Replies