tELTSAPMap and file tranfer. How to compress ? + tFTPGet / SFTP

[SRoux]

Hello,

We use tSAPConnection, tELTSAPMap and custom function modules (BAPI) given by Talend to retrieve data from SAP. File transfer parameters is used to download data files result. However data file size is large (1 Go) and takes lot of time to download (25mn in this example).

--> Is there any mecanism to compress data file on the side of SAP before downloading ? I think about SAP properties set through tSAPConnection

In our case file result is only characters and lot of blanks and compress ratio is 99.25% !

Thank you for your feedback

[SRoux]

Checked with the support, there is no compression feature available on the side of SAP via the Talend custom function module.

Now thinking about SFTP protocol. I know It is possible to enable compression on the client side. But we need to put some option on line command.

Is there a way to pass some parameters to force compression ? with tELTSAPMap or well know component like tFTPGet and tFTPConnection ?

Here an old post with a similar question : https://www.talendforge.org/forum/viewtopic.php?id=9192

example : $ sftp -oCompression=yes yourlogin@yoursftpserver

. with a text file and compression activated download takes : 100% 62MB 41.2MB/s 00:01

. And without compression : 100% 62MB 1.2MB/s 00:52