topic Re: GET the last file from Remote directory ftp in Talend Studio

GET the last file from Remote directory ftp

Anonymous — Sat, 16 Nov 2024 09:46:56 GMT

Hello Community ,

I need help plaiiiise

I wanna get all the recent file from a remote directory FTP to my local ,then delete this file from local after appload them to my Mysql Database:

the remote directory contain a CSV file withe the name like 20170515_Contact.csv (2017:year,05 month, 15 day)

every day there is the new files.

i wanna just get the file of the recent day.

this is my job : tftpconnection-->tftlistfile-->tftpget--tfileinputDelimeted-->tlogrow-->tmap--->mysqloutput

help me to configure all this component in order to get just the recent file to my local directory then delete them after having all the date at mysql

thank youuuuuuuuuuuuuuu

Re: GET the last file from Remote directory ftp

TRF — Mon, 15 May 2017 21:48:08 GMT

Try this:

tFTPConnection-->tFTPGet--tFileInputDelimited-->tLogTow-->tMap--->tMysqlOutput (no tFTPFileList component).

To get the file for the current day from your FTP server, add a filemask with the following syntax:

TalendDate.formatDate("yyyyMMddHH",TalendDate.getCurrentDate()) + "_Contact.csv"

The component should look like this:

If necessary, define the local directory according to the place where you want to get the file with the tFileInputDelimited.

Re: GET the last file from Remote directory ftp

vapukov — Tue, 16 May 2017 00:26:13 GMT

This is not really most resent file, as example most resent mean - You have 3 backup from same day, but need take latest

but Your tasks could be achieved with simple name patterns:

For yesterday:

TalendDate.formatDate("yyyyMMdd",TalendDate.addDate(TalendDate.getCurrentDate() ,-1,"dd")) +"*.csv"
or

TalendDate.formatDate("yyyyMMdd",TalendDate.addDate(TalendDate.getCurrentDate() ,-1,"dd")) +"_Contact.csv"

For today:

TalendDate.formatDate("yyyyMMdd",TalendDate.getCurrentDate()) +"*.csv"
or

TalendDate.formatDate("yyyyMMdd",TalendDate.getCurrentDate()) +"_Contact.csv"

use this pattern for tFTPFileList

Re: GET the last file from Remote directory ftp

Anonymous — Tue, 16 May 2017 08:46:32 GMT

Thank you very much

Re: GET the last file from Remote directory ftp

Anonymous — Tue, 16 May 2017 08:46:51 GMT

Thank you

Re: GET the last file from Remote directory ftp

TRF — Fri, 25 May 2018 11:09:15 GMT

@informatiste thank's to mark your case as solved (Kudos also accepted)

Re: GET the last file from Remote directory ftp

Anonymous — Tue, 11 Sep 2018 09:45:25 GMT

@vapukov, I used the same for my job that has to fetch files from ftp server. The job works but doesn't get any files on to local directory despite them being on ftp. The date format on ftp is dd/MM/yyyy HH:mm:ss. Could that be the reason?

Re: GET the last file from Remote directory ftp

Anonymous — Mon, 24 Sep 2018 12:45:50 GMT

down vote The answer is that you probably can't do this using just wget or any other single tool that I am aware of. What you probably need to do is write a script that will use wget/curl/whatever that will request a directory listing from the ftp server. Then the script will select and retrieve the right file based on the file's name, or some other criteria Clean Master Facebook Lite Mathway

Re: GET the last file from Remote directory ftp

Anonymous — Mon, 01 Jun 2020 12:21:25 GMT

GET the last document from Remote registry ftp...

Thanks for this help.It guided me a lot......whereaminw