topic Re: Checking If file is already downloaded SFTP in Local Directory and archive the treated Files in Talend Studio

Checking If file is already downloaded SFTP in Local Directory and archive the treated Files

kakooo16 — Fri, 24 Apr 2020 09:04:50 GMT

Hello ,

I want to check if file exists in my local directory then i don't download it because im talking about large files .

Here is my job design :

Then , put the treated files into an archive .

Thanks in advance .

Re: Checking If file is already downloaded SFTP in Local Directory and archive the treated Files

Anonymous — Fri, 24 Apr 2020 09:12:45 GMT

Before you download the file, you can use tFileExist to check if the same file name already exists in local system, and then use runIf connector to trigger next processing. eg:
.bababaa--tFtpFileList--iterate--tFileExist--runIf--tFTPGet....

on tFileExist, set the file path as:
"the local folder path/"+((String)globalMap.get("tFTPFileList_1_CURRENT_FILE"))

set the condition of runIf as:
!((Boolean)globalMap.get("tFileExist_1_EXISTS"))

Hope it helps you!

Regards
Shong

Re: Checking If file is already downloaded SFTP in Local Directory and archive the treated Files

kakooo16 — Fri, 24 Apr 2020 10:14:12 GMT

Thanks @shong it works perfectly and how about to archive the files in a new directory after beeing treated ? .

Re: Checking If file is already downloaded SFTP in Local Directory and archive the treated Files

Anonymous — Fri, 24 Apr 2020 10:44:42 GMT

try tFileArchive component.

Re: Checking If file is already downloaded SFTP in Local Directory and archive the treated Files

kakooo16 — Fri, 24 Apr 2020 10:46:15 GMT

without tFileCopy ?

Re: Checking If file is already downloaded SFTP in Local Directory and archive the treated Files

Anonymous — Fri, 24 Apr 2020 11:19:54 GMT

yes, without tFileCopy, just set the Archive file path to another directory, I did't test it, let me know if you have any issues.

Re: Checking If file is already downloaded SFTP in Local Directory and archive the treated Files

kakooo16 — Fri, 24 Apr 2020 11:42:19 GMT

In fact , i need to copy the files to a new directory so : my job looks like :

Am i correct to configure this way my tFileArchive :

In the file Archive section i ve put : ((String)globalMap.get("tFileList_1_CURRENT_FILE")).

@shong If my workflow is correct let me know .

Thanks for your advices