Downloading multiple files from sftp server to a local folder and executing python scripts to them one by one and finally moving the files to the archive

Anonymous — Sat, 16 Nov 2024 07:56:37 GMT

I want to built a job which looks up in the sftp folder for different excel files and downloads it to the local directory and executes a python script to them one by one and finally moves them to the archive. For this purpose I have created a job as in the screenshot. (Please ignore connection2: its for streaming purpose)

I am very new to Talend. When I run the job. It just executes one file from 3 of them and leaves the two untouched. I would like the job to look for multiple files and download it to the local folder and if the file already exist in local folder and sftp, just execute the script on the next excel after downloading it. Can anyone give me some hint, how this would be possible. Thank you so much

Re: Downloading multiple files from sftp server to a local folder and executing python scripts to them one by one and finally moving the files to the archive

Anonymous — Wed, 25 Jul 2018 10:06:02 GMT

Hello,

From your screenshots, there is no connectors(onsubjobok) between tFTPconnection and your tftpfilelist. Could you please have look at this scenario:TalendHelpCenter:Listing and getting files/folders on an FTP directory?

Best regards

Sabrina

topic Re: Downloading multiple files from sftp server to a local folder and executing python scripts to them one by one and finally moving the files to the archive in Talend Studio

Downloading multiple files from sftp server to a local folder and executing python scripts to them one by one and finally moving the files to the archive

Re: Downloading multiple files from sftp server to a local folder and executing python scripts to them one by one and finally moving the files to the archive