getting error in hdfsput

Anonymous — Sat, 16 Nov 2024 04:23:39 GMT

I have an error in my talend like this when i want to put file to my hdfs. I have checked the fs.defaultFS and it has same with my component, but i'm still getting this error like this. I also have see the core-site.xml and it also same with my component.

Exception in component tHDFSPut_1 (hs_job)
java.io.EOFException: End of File Exception between local host is: "xxxxxx/xxx.xxx.xxx.xxx"; destination host is: "xxx.xxx.xxx.xxx":8020; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:801)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:765)
at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1558)
at org.apache.hadoop.ipc.Client.call(Client.java:1498)
at org.apache.hadoop.ipc.Client.call(Client.java:1398)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233)
at com.sun.proxy.$Proxy11.mkdirs(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:605)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:291)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:203)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:185)
at com.sun.proxy.$Proxy12.mkdirs(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:3073)
at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:3043)
[FATAL]: hive_assignment.hs_job_0_1.hs_job - tHDFSPut_1 End of File Exception between local host is: "xxxxxx/xxx.xxx.xxx.xxx"; destination host is: "xxx.xxx.xxx.xxx":8020; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException

Re: getting error in hdfsput

Anonymous — Wed, 16 Oct 2019 08:49:13 GMT

Hello,

We need more information to address your issue. Could you please indicate on which talend bigdata build version you got this issue? Screenshots of your job design and component setting will be preferred.

Best regards

Sabrina

topic getting error in hdfsput in Talend Studio

getting error in hdfsput

Re: getting error in hdfsput