topic tFTPDelete - Is it NOT possible to delete all files (from the server) but still keep the folder? in Talend Studio

tFTPDelete - Is it NOT possible to delete all files (from the server) but still keep the folder?

Anonymous — Fri, 14 Sep 2018 20:57:24 GMT

I wanted to delete the files from a remote folder and I used the tFTPDelete component. Here is the configuration for it:

Basically, I wanted to empty this folder but KEEP the folder still. Initially, I put "*" on filemask and the job failed, and below is the error code:

Exception in component tFTPDelete_3 (movefiles)
24: This request cannot be used to remove a directory
at com.jcraft.jsch.ChannelSftp.throwStatusError(ChannelSftp.java:2846)
at com.jcraft.jsch.ChannelSftp.rm(ChannelSftp.java:1958)

Then I put a new filemask ( shown above), all the files match that pattern except one .zip file. I ran the job again and the files were deleted, only .zip was left in the folder.

BTW, both times the Target Type was "File".

I am thinking - does tFTPDelete not allow us to empty a folder if we choose "File" as Target Type?

Re: tFTPDelete - Is it NOT possible to delete all files (from the server) but still keep the folder?

Anonymous — Fri, 14 Sep 2018 21:23:43 GMT

You're right -- the Target Type will control what jsch method will be called ( ChannelSftp.rm() for files and ChannelSftp.rmdir() for directories ).

you may find some success with this approach:
first attempt to delete all the files. uncheck die on error in the first tFTPDelete component. connect another tFTPDelete with a onComponentError connector and then try to delete the directories.

Re: tFTPDelete - Is it NOT possible to delete all files (from the server) but still keep the folder?

Anonymous — Fri, 14 Sep 2018 21:37:32 GMT

JGM,

Thanks for your quick response, here is what I observed:

Even though "Die on error" was unticked, the job still wouldn't run, it would just stop:

This request cannot be used to remove a directory
[statistics] disconnected

2. Only one component is needed to delete the files and directory:

My question still is : how to delete the files and still keep the folder on remote server? Is that possible?

Re: tFTPDelete - Is it NOT possible to delete all files (from the server) but still keep the folder?

Anonymous — Mon, 24 Sep 2018 22:48:22 GMT

I think I get the answer to my own question.

If I want to delete all the files from a folder but still keep the directory, I will need to use specific file mask(s) which would delete all the files, but the file mask shouldn't be "*".

For example, if I have below files in a folder, I should use file mask "Testfile_*" and "file_*" to delete all the files.

Testfile_001.xlsm

Testfile_002.xlsm

file_001.xlsm

file_002.xlsm

As long as specific file mask(s) is used to delete all the files, it doesn't matter Target Type is "File" or "Directory", it would only delete the files and always keep the directory.

Only the file mask "*" + Target Type "Directory" combination would delete the directory.

Re: tFTPDelete - Is it NOT possible to delete all files (from the server) but still keep the folder?

manodwhb — Tue, 25 Sep 2018 06:16:56 GMT

@Moe,yes you can use the data mask from the tFTPList.

tFTPList--Iterate-->tFTPDelete and use the global parameter from FTPList in FTPDelete.