topic Re: Reading file from remote server in Talend Studio

Reading file from remote server

Anonymous — Thu, 09 Jan 2014 11:28:46 GMT

Hi,
We have a requirement to read the file from the Remote Server (Linux) and have to load them into the Target.
If am not wrong it can be established using FTP components. But the Limitation is I should not copy the File to the local directory. Is there any way to read the data from the file in remote server without copying them onto my local machine Inputs would be useful.
Thanks

Re: Reading file from remote server

Anonymous — Thu, 09 Jan 2014 13:27:29 GMT

hi,
use buffer (tBufferOutput) to store in memory.
And read it later with tBufferInput.
as it store in memory adapt you jvm allocated memory to your need.
hope it helps
regards
laurent

Re: Reading file from remote server

Anonymous — Thu, 09 Jan 2014 15:20:46 GMT

Hi,
Thanks for the quick reply..
If the volume of data is less means we can go with that.
But in our case the volume of data is large.
So i fear JVM memory cant be changed to our need.
Thanks

Re: Reading file from remote server

janhess — Thu, 09 Jan 2014 15:23:10 GMT

Can you run your job on the remote server? What is your target?

Re: Reading file from remote server

Anonymous — Tue, 10 Feb 2015 21:36:05 GMT

I am also facing the same issue. My talend job has to read a file from unix server and load it into oracle database. Is there a way we can achieve this ? The file size in this case is big.

Re: Reading file from remote server

Anonymous — Wed, 13 Feb 2019 17:16:05 GMT

I too have similar kind of requirement reading file directly from remote. Appreciate if any suggestions

Re: Reading file from remote server

akumar2301 — Wed, 13 Feb 2019 20:15:27 GMT

Try below example with tfilefetch. Supports http, https, ftp and smb

https://help.talend.com/reader/jomWd_GKqAmTZviwG_oxHQ/wZphtUXJPNp32p65z7XSgQ?section=Raa47862