Talend Open studio Component Installer ignores proxy in 7.2

[Anonymous]

Hi,

Like many of us, I live behind corporate proxy. In 7.0.1 the component installer works with proxy as expected. However, recently I tried to upgrade to 7.2.1 and utterly failed. I have proxy set at JVM level, at the application properties and in Java console. The component installer ignores all of it and still attempts direct connection. I verified this with Wireshark. 

Log entries for the failure.

!ENTRY org.talend.platform.logging 1 0 2019-07-30 10:54:17.371
!MESSAGE 2019-07-30 10:54:17,362 INFO org.talend.librariesmanager.librarydata.LibraryDataService - org.eclipse.aether.resolution.ArtifactResolutionException: Could not transfer artifact org.postgresqlostgresqlom:42.2.5 from/to talend (https://talend-update.talend.com/nexus/content/repositories/libraries/😞 Connection refused: connect

!ENTRY org.talend.platform.logging 1 0 2019-07-30 10:54:18.482
!MESSAGE 2019-07-30 10:54:18,473 INFO org.talend.librariesmanager.librarydata.LibraryDataService - org.eclipse.aether.resolution.ArtifactResolutionException: Could not transfer artifact net.sourceforge.jtds:jtdsom:1.3.1-patch-20190523 from/to talend (https://talend-update.talend.com/nexus/content/repositories/libraries/😞 Connection refused: connect

Maybe there is a fourth way to set proxy that the LibraryDataService does respect?

I noted, that  the "Update componets" part seems to respect the proxy set in Java console, not the one in the env/preferences. However, nothing seems to apply to the single component installers. 

[Anonymous]

Hi,

It does not really matter how he configures it - the Eclipse base used in 7.2 has a bug in the proxy handling and no proxy configuration will take effect for certain library downloads... Unfortunately - you cant use 7.2 if you are behind a proxy. That was my conclusion. I'm still using 7.1 and hoping that the next version inherits from  eclipse a fixed proxy handling.

Best,

Thade 

[schneich]

---

@xdshi wrote:

Hello @schnech1，

There is no such a detailed manual on "how to set up a proxy connection in corporate environment" as the corporate environment is complex and uncertain.

Are you getting credential problem when configuring proxy setting?

Best regards

Sabrina

---

Hi, unfortunately no. I only get log-entries such as this:

!ENTRY org.talend.platform.logging 1 0 2019-11-04 16:11:48.461 !MESSAGE 2019-11-04 16:11:48,461 INFO org.talend.librariesmanager.librarydata.LibraryDataService - org.eclipse.aether.resolution.ArtifactResolutionException: Could not transfer artifact org.talend.libraries:jxl om:6.0.0 from/to talend ( https://talend-update.talend.com/nexus/content/repositories/libraries/😞 connect timed out

@thade Proxy-configuration has been a pain in every talend version. I took me weeks to get it working in version 7.0.1. I will try version 7.1 and test, if it is working there.

[schneich]

Dear @thade and @xdshi ,

I just had a little session with our network specialist. A little summary.

We have a corporate environment with proxy (NTLM-Authentication), firewall and ssl-interception, scanning of internet traffic, ...

Version 7.0.1

To connect "Talend Data Integration" to the internet to be able to download additional components, we had to set an exception in the proxy. The proxy no longer asks for authentication, when trying to access the talend-update.talend.com URLs. With this rules, everything was fine.

Version 7.1

In addition to the above set of roules, we had to add "talend.com" to the list. I am not sure why, but now we are able to update Version 7.1 with additional components out of the talend repository.

Version 7.2

I can now confirm the statement of @thade : Talend Open Studio for Data Integration 7.2.1 does not use the proxy-configurations, but tries to access the internet directly. This is blocked by our network environment. (screenshot of our firewall)

Then there is something else: Talend sometimes asks me for the Community-Login. I added my credentials, but nothing seems to change. today, we have seen this error in the proxy-log. The proxy does not allow the connection to www.talendforge.org, because NTLM-Authentication does not work and because we did not add the url to the whitelist in the prosxy. 

connection: service.name=Explicit HTTP client.address=xxx.xxx.xxx.xxx proxy.port=xx client.interface=0:0.1 routing-domain=default
  location-id=0 access_type=unknown
time: 2019-11-08 08:24:10 UTC
GET http://www.talendforge.org/exchange/webservices/contributedExtension.php?data={"contributedExtension":{"passwordHash":"xxx","username":"schnech1"}}
  DNS lookup was unrestricted
User-Agent: Java/1.8.0_232
user: unauthenticated
authentication status='need_credentials' authorization status='not_attempted'
EXCEPTION(authentication_failed): Authentication failed either because credentials were not provided or they could not be validated

[Anonymous]

Hello @schnech1 

Thanks for your summary. Does this issue only repro in V 7.2?

Best regards

Sabrina

[schneich]

Hi @xdshi,

Hello @schnech1 

Thanks for your summary. Does this issue only repro in V 7.2?

Best regards
Sabrina

I assume you refere to my comment on the community login? No, this is related to Talend not being able to use proxy and NTLM-Authentication. This issue is present in all Talend versions 7.x. (As far as I know, the whole issue is based on the Eclipse version underneath Talend.)

[anna_t1]

What a headache? Has this been solved somehow? I'm still facing the same issues on 7.2 and I can't go change versions. I must submit to a linux server running this version, but when I try to build, it's always giving me error, because it can't fetch libraries through th proxy!

I've literally spent HOURS, trying to solve this.

This is ridiculous ... just ridiculous.

Talend should have provide a clean solution for this....

[Anonymous]

Hello,

Sorry for any inconvenience.

What does your proxy settings of studio preferences look like?

Please make sure that configuring HTTP and HTTPS proxy at the same time, and user/password should be configured correctly both for HTTP and HTTPS.

So far, it seems that studio doesn't support ntlm authentication.

Is it possible to use BASIC authentication? or even don't use any authentication?

Best regards

Sabrina

[Anonymous]

Hello,

Please add --talendDebug and -Dtalend.studio.proxy.printLogs=true when starting studio to try to catch proxy related logs and then attach all studio logs.

Best regards

Sabrina