Databricks AWS connection throwing SSLHandshakeException

karthikj18 — Sat, 16 Nov 2024 02:37:39 GMT

I'm using Talend BigData 7.3.1. I am trying to connect a Databricks cluster hosted on AWS from Talend. Configured cluster url, cluster id and token properly. I tried providing invalid cluster id too, same error. Below is the error message.

Any help would be appreciated?

org.talend.bigdata.launcher.utils.BigDataLauncherException: Error getting content of remote folder '/FileStore/jars/'
at org.talend.bigdata.launcher.fs.DatabricksFileSystem.list(DatabricksFileSystem.java:199)
at org.talend.bigdata.launcher.fs.DatabricksFileSystem.list(DatabricksFileSystem.java:144)
at org.talend.bigdata.launcher.fs.DatabricksFileSystem.updateDatabricksJarList(DatabricksFileSystem.java:567)
at org.talend.bigdata.launcher.databricks.DatabricksJob.uploadJars(DatabricksJob.java:152)
at org.talend.bigdata.launcher.databricks.DatabricksJob.executeJob(DatabricksJob.java:385)
at local_project.databricks_0_1.Databricks.runClientJob(Databricks.java:710)
at local_project.databricks_0_1.Databricks.runJobInTOS(Databricks.java:523)
at local_project.databricks_0_1.Databricks.main(Databricks.java:409)
Caused by: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.ssl.Alerts.getSSLException(Alerts.java:192)
at sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1946)
at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:316)
at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:310)
at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1639)
at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:223)
at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1037)
at sun.security.ssl.Handshaker.process_record(Handshaker.java:965)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1064)
at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1367)
at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1395)
at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1379)
at org.talend.bigdata.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:436)
at org.talend.bigdata.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:384)
at org.talend.bigdata.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
at org.talend.bigdata.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:374)
at org.talend.bigdata.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393)
at org.talend.bigdata.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
at org.talend.bigdata.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
at org.talend.bigdata.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.talend.bigdata.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.talend.bigdata.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.talend.bigdata.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.talend.bigdata.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.talend.bigdata.http.client.fluent.Request.internalExecute(Request.java:173)
at org.talend.bigdata.http.client.fluent.Request.execute(Request.java:177)
at org.talend.bigdata.launcher.fs.DatabricksFileSystem.list(DatabricksFileSystem.java:166)
... 7 more
Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:397)
at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302)
at sun.security.validator.Validator.validate(Validator.java:262)
at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:324)
at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:229)
at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:124)
at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1621)
... 29 more
Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)
at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)
at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280)
at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:392)
... 35 more

Re: Databricks AWS connection throwing SSLHandshakeException

manodwhb — Wed, 22 Apr 2020 05:15:44 GMT

@karthikj18 , check the below link may help you.

https://community.talend.com/t5/Design-and-Development/Three-ways-to-set-a-truststore-for-an-SSL-TLS-connection-in-a/ta-p/34811

Re: Databricks AWS connection throwing SSLHandshakeException

karthikj18 — Mon, 27 Apr 2020 22:54:06 GMT

Thanks Manohar.

I follows the link, but there is a glitch in instructions.

I have figured out it.

Use

-Djavax.net.ssl.trustStore=C:\databricks.jks, note no double quotes in file path.

-Djavax.net.ssl.trustStorePassword="xxxx" -- note double quotes in password

Thanks.

topic Re: Databricks AWS connection throwing SSLHandshakeException in Talend Studio

Databricks AWS connection throwing SSLHandshakeException

Re: Databricks AWS connection throwing SSLHandshakeException

Re: Databricks AWS connection throwing SSLHandshakeException