unable to append & overwrite the existing file in thdfsoutput

[Anonymous]

Hi all,

am facing the issue which unable to overwrite & append the existing file have placed in the "file name" in thdfsoutput .

For every time it was creating new file (FILE_1 to create success) if i applied new filename in the "file name path" option but again want to append this (FILE_1) it was showing this  below error.

Exception in component tHDFSOutput_1 (FL_tsgal005255_r)
java.io.IOException: DataStreamer Exception:
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:577)
Caused by: java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:101)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:622)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
at org.apache.hadoop.hdfs.DFSOutputStream.createSocketForPipeline(DFSOutputStream.java:1601)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1342)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1295)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:463)
[FATAL]: godrej_test.fl_tsgal005255_r_0_1.FL_tsgal005255_r - tHDFSOutput_1 DataStreamer Exception:

[manodwhb]

@saibabu ,check the below post may be the same issue in your case.

https://community.talend.com/t5/Design-and-Development/resolved-Simple-tHDFSPut-based-job-fails-on-6...

[Anonymous]

Hi,

    What is the value you are using in Action?

Are you facing this issue in this file or all files?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂