Talend Open Studio for Data Quality -> Connectivity to Databricks

JuttuSenthil — Fri, 15 Nov 2024 22:50:21 GMT

Dear Team,

Really appreciate your help asap to move forward with the issue. Thank You in Advance.

https://community.talend.com/s/feed/0D55b00007MoAVeCAN

In continuation to the above conversation, we are also trying to explore if we can connect to Databricks from Talend Open Studio for Data Quality via General JDBC connectivity that is available under DB Connections.

The following link has got details of how to setup the JDBC URL and related driver.

https://docs.databricks.com/integrations/bi/jdbc-odbc-bi.html# jdbc-driver

We have setup the URL and trying to connect from TOS for data quality and end up with below error. No clue of what the error is about. It says "Impossible to initialize the connection" but nothing specific.

Could someone help if we are in right direction and where to debug the error?

Please refer to attached screen shot for the connection setup.

URL

jdbc:spark://<server-name>:443/default;transportMode=http;ssl=1;httpPath=<path>;AuthMech=3;UID=token;PWD=<personal access token>

java.lang.Exception: Impossible to initialize the connection !

at org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.connect(ExtractMetaDataUtils.java:1212)

at org.talend.metadata.managment.utils.MetadataConnectionUtils.createConnection(MetadataConnectionUtils.java:189)

at org.talend.metadata.managment.utils.MetadataConnectionUtils.createConnection(MetadataConnectionUtils.java:130)

at org.talend.metadata.managment.model.DBConnectionFillerImpl.fillUIConnParams(DBConnectionFillerImpl.java:165)

at org.talend.metadata.managment.model.DBConnectionFillerImpl.fillUIConnParams(DBConnectionFillerImpl.java:1)

at org.talend.metadata.managment.model.MetadataFillFactory.fillUIConnParams(MetadataFillFactory.java:180)

at org.talend.cwm.db.connection.ConnectionUtils.updataTaggedValueForConnectionItem(ConnectionUtils.java:1226)

at org.talend.dataprofiler.core.ui.views.RespositoryDetailView.createDataProviderDetail(RespositoryDetailView.java:682)

at org.talend.dataprofiler.core.ui.views.RespositoryDetailView.selectionChanged(RespositoryDetailView.java:266)

at org.eclipse.ui.internal.e4.compatibility.SelectionService.notifyListeners(SelectionService.java:266)

at org.eclipse.ui.internal.e4.compatibility.SelectionService.handleSelectionChanged(SelectionService.java:98)

at org.eclipse.ui.internal.e4.compatibility.SelectionService.lambda$0(SelectionService.java:72)

at org.eclipse.e4.ui.internal.workbench.SelectionAggregator$1.run(SelectionAggregator.java:123)

at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:45)

at org.eclipse.e4.ui.internal.workbench.SelectionAggregator.notifyListeners(SelectionAggregator.java:120)

at org.eclipse.e4.ui.internal.workbench.SelectionAggregator$5.lambda$0(SelectionAggregator.java:220)

at org.eclipse.e4.core.contexts.RunAndTrack.runExternalCode(RunAndTrack.java:59)

at org.eclipse.e4.ui.internal.workbench.SelectionAggregator$5.changed(SelectionAggregator.java:220)

Thanks,

Senthil

Re: Talend Open Studio for Data Quality -> Connectivity to Databricks

Anonymous — Tue, 14 Jun 2022 05:04:07 GMT

Hello,

Without using talend tool, are you able to connect Databricks database successfully via JDBC URL and related driver( DB client)?

If you are trying to use some databases from the Profiling perspective of Talend Studio, please make sure that your Databricks database is list in the Supported databases table for profiling data.

Here is online documentation about: TalendHelpCenter: Supported databases for profiling data

Best regards

Sabrina

topic Talend Open Studio for Data Quality -> Connectivity to Databricks in Data Quality

Talend Open Studio for Data Quality -> Connectivity to Databricks

Re: Talend Open Studio for Data Quality -> Connectivity to Databricks