Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to get file from ftp and load to HDFS?

Hi, 
I want to get files from FTP and load into HDFS, but the component tFTPGet just can move files into a local directory. How can I move into the HDFS? Thank you

 

 

Labels (4)
4 Replies
TRF
Champion II
Champion II

You need to proceed in 2 steps:
- tFtpGet to the file locally
- tHDFSOutput to push from local to HDFS
manodwhb
Champion II
Champion II

@fransiskakd ,you can design in below way also.

0683p000009M87b.png

Anonymous
Not applicable
Author

Thanks for your response , but I do not want to store the data in local repository because the talend job will upload in talend server and run automatically without having to open my local directory. Is there any other way?

TRF
Champion II
Champion II

@fransiskakd you don't have choice.

tHDFSOutput component requires an input flow so you have to get the file locally (locally mining where the job runs) then read the file to push data into tHDFSOutput and finally, delete the local file.