tFtp or tscp with http proxy

[Anonymous]

Hi,

I am using Talend for Big data 6.4 and I want to get files from ftp. However as I am behind proxy, I need to set http proxy to get the files. 

I have tested this with winscp and it works with http proxy. 

However, when I tried with tScp with tSetProxy, it fails. 

[statistics] connecting to socket on port 3740
[statistics] connected
Exception in component tSCPConnection_1 (ftpLanding)
java.io.IOException: There was a problem while connecting to 134.178.253.145:21
at ch.ethz.ssh2.Connection.connect(Connection.java:805)
at ch.ethz.ssh2.Connection.connect(Connection.java:595)
at first.ftplanding_0_1.ftpLanding.tSCPConnection_1Process(ftpLanding.java:379)
at firstftplanding_0_1.ftpLanding.tSetProxy_1Process(ftpLanding.java:592)
at firstftplanding_0_1.ftpLanding.runJobInTOS(ftpLanding.java:848)
at firstftplanding_0_1.ftpLanding.main(ftpLanding.java:674)
Caused by: java.net.ConnectException: Connection timed out: connect
at java.net.DualStackPlainSocketImpl.connect0(Native Method)
at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
[FATAL]: ftplanding_0_1.ftpLanding - tSCPConnection_1 There was a problem while connecting to 134.178.253.145:21

I have also tried with tFtpget, however that was not suitable as it does not have http proxy. It only has socks proxy, which did not work for me as well. 

How can I solve this?

[Anonymous · Accepted solution]

Hello,

So far, we don't have any update for this jira issue:https://jira.talendforge.org/browse/TDI-39093

Best regards

Sabrina

[Anonymous]

Thank you for that. We also raised a support ticket and they asked to look at using custom code for tFtp. 

- use tJava component and write your own java code to go through the proxy and get the file:
https://commons.apache.org/net/examples/ftp/FTPClientExample.java or https://www.example-code.com/java/ftp_http_tunnel.asp

-Or use the tSystem/tSSH to connect and run command

I tried the ssh, which did not work. Have not got to adding the ftp tunnelling yet. 

[Anonymous]

Hello,

Thank for sharing your update with us and feel free to let us know if there is any further help we can give.

Best regards

Sabrina