topic Re: tFtp or tscp with http proxy in Talend Studio

tFtp or tscp with http proxy

Anonymous — Sat, 16 Nov 2024 09:16:22 GMT

Hi,

I am using Talend for Big data 6.4 and I want to get files from ftp. However as I am behind proxy, I need to set http proxy to get the files.

I have tested this with winscp and it works with http proxy.

However, when I tried with tScp with tSetProxy, it fails.

[statistics] connecting to socket on port 3740
[statistics] connected
Exception in component tSCPConnection_1 (ftpLanding)
java.io.IOException: There was a problem while connecting to 134.178.253.145:21
at ch.ethz.ssh2.Connection.connect(Connection.java:805)
at ch.ethz.ssh2.Connection.connect(Connection.java:595)
at first.ftplanding_0_1.ftpLanding.tSCPConnection_1Process(ftpLanding.java:379)
at firstftplanding_0_1.ftpLanding.tSetProxy_1Process(ftpLanding.java:592)
at firstftplanding_0_1.ftpLanding.runJobInTOS(ftpLanding.java:848)
at firstftplanding_0_1.ftpLanding.main(ftpLanding.java:674)
Caused by: java.net.ConnectException: Connection timed out: connect
at java.net.DualStackPlainSocketImpl.connect0(Native Method)
at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
[FATAL]: ftplanding_0_1.ftpLanding - tSCPConnection_1 There was a problem while connecting to 134.178.253.145:21

I have also tried with tFtpget, however that was not suitable as it does not have http proxy. It only has socks proxy, which did not work for me as well.

How can I solve this?

Re: tFtp or tscp with http proxy

Anonymous — Tue, 26 Sep 2017 08:27:23 GMT

Hello,

So far, we don't have any update for this jira issue:https://jira.talendforge.org/browse/TDI-39093

Best regards

Sabrina

Re: tFtp or tscp with http proxy

Anonymous — Wed, 27 Sep 2017 00:57:23 GMT

Thank you for that. We also raised a support ticket and they asked to look at using custom code for tFtp.

- use tJava component and write your own java code to go through the proxy and get the file:
https://commons.apache.org/net/examples/ftp/FTPClientExample.java or https://www.example-code.com/java/ftp_http_tunnel.asp

-Or use the tSystem/tSSH to connect and run command

I tried the ssh, which did not work. Have not got to adding the ftp tunnelling yet.

Re: tFtp or tscp with http proxy

Anonymous — Wed, 27 Sep 2017 04:47:56 GMT

Hello,

Thank for sharing your update with us and feel free to let us know if there is any further help we can give.

Best regards

Sabrina