topic Read FTP Files Directly in Talend Studio

Read FTP Files Directly

Anonymous — Thu, 16 Mar 2017 01:43:28 GMT

Hi,
I was just wondering if there is a way in Talend to read FTP files directly without downloading them to local drive?
I want to load data from ftp files to mysql database directly.
Thank you!

Re: Read FTP Files Directly

vapukov — Thu, 16 Mar 2017 01:50:45 GMT

map network drive as local - NFS for Linux, SMB for Windows
FTP not mean read files - it is File Transfer Protocol

Re: Read FTP Files Directly

Anonymous — Thu, 16 Mar 2017 02:05:34 GMT

vapukov wrote:
map network drive as local - NFS for Linux, SMB for Windows
FTP not mean read files - it is File Transfer Protocol

thanks for your reply.
yes i know what ftp means. i was just wondering if there is one component in talend that "reads" the ftp file directly. by "reads" i mean, the component does the accessing, downloading/transferring of file (to a temp folder), then after the job runs, automatically deletes the file.
Currently, I will have to use at least three components to this. My talend job already has a lot of component, complex and complicated, inside it and I wanted to avoid adding more if I can.
If there is none, that is fine.

Re: Read FTP Files Directly

vapukov — Thu, 16 Mar 2017 02:12:46 GMT

no, not this component present

ftp is legacy protocol, it wide supported, but still legacy
if You want change something - think wide (different), the are many variants:
[list=1]

as mentioned above - map drive as local

change Pull to Push technology, make the Job running on Source, which - upload file to Target server.

Run daemon on source - parse (tail) files and push row by row to message queue

same as before but from source application if possible - direct to MQ (kafka as example)

etc