Slow FTP upload because of files listing: any workaround?

[lennelei]

Hi all,

We have some jobs using Talend to upload files on FTP that have always been slow but we never took the time to investigate until today.

I saw (in the generated code as well as with Wireshark) that each time the tFTPPut component is called, it first starts with a directory listing.
That's a problem for us as the FTP destination directory is large with a lot of files. In consequence, for each uploaded file (50 kB for the biggest, 5kB for the smallest), there is a directory listing that took approximately 500 kB (between 10 and 100 times the size of the file send).

Any workaround to avoid a full directory listing for each file?

Tested on a very simple job:
tPreJob->TFTPConnection
tFileList->tFTPPut (using existing connection)

Thanks.
Regards.

Alexis

[Anonymous]

Hi
What's the type of overwrite file on your tFTPPut component?

[lennelei]

Hi,

Overwrite is set on "Always"

Regards