topic Re: [resolved] tHDFSPut: Empty File in Talend Studio

[resolved] tHDFSPut: Empty File

Anonymous — Sat, 16 Nov 2024 09:58:03 GMT

I'm doing a simple file transformation. I take an input file, map it to an output file, make a field uppercase, and put on disk. Then I use tHDFSPut to put into HDFS.
The file gets uploaded to HDFS, but it's empty. The corresponding file on my local file system is fine.
I get a red "Error!" above the tHDFSPut task (see picture), but there are no compile errors.
The log has no error information in it.
How can I find out what the heck is going on?

Re: [resolved] tHDFSPut: Empty File

Anonymous — Tue, 28 Mar 2017 09:46:25 GMT

Hi,
The tHDFSOutput component runs standalone and does not generate input or output flow for the other components.
It is often connected to the Job using OnSubjobOk or OnComponentOk link, depending on the context.
Could you please re-design your work flow:tfileinputxx-->tMap-->tfileoutput-->onsubjobok-->tHDFSPut to see if it works?
Best regards
Sabrina

Re: [resolved] tHDFSPut: Empty File

Anonymous — Tue, 28 Mar 2017 13:19:27 GMT

Thanks, I figured that out and got it working.
Gary

Re: [resolved] tHDFSPut: Empty File

Anonymous — Tue, 28 Mar 2017 13:24:44 GMT

Hi,
Thanks for marking this topic as resolved.
Best regards
Sabrina