Databricks Lakehouse (Delta) Target connection not working in DRP server.

[SaidSayyad]

Hello Team,

we are using Databricks Lakehouse (Delta) as a target. while setup connection we are observing below error.

we tried to uninstall & re-install  Simba Sparks driver version simbaspark-2.6.26.1045-1.x86_64.rpm. we also updated Simba file but still facing same error.

Update file /opt/simba/spark/Setup/odbcinst.ini

Add lines :

# Driver from the SimbaSparkODBC-2.6.29.1049-LinuxRPM-64bit package

# Setup from the unixODBC package

[Simba Spark ODBC Driver]

Description     = Simba Apache Spark ODBC Connector (64-bit)

Driver          = /opt/simba/spark/lib/64/libsparkodbc_sb64.so

Test connection Error: 

• Failed prepare Cloud component
• Cannot connect to Cloud server RetCode: SQL_ERROR SqlState: 01000 NativeError: 0 Message: [unixODBC][Driver Manager]Can't open lib 'Simba Spark ODBC Driver' : file not found

Logfile error:

01958621: 2023-09-29T10:32:27:706457 [STREAM_COMPONEN ]I: Going to connect to server westeurope.azuredatabricks.net database (null) (cloud_imp.c:3883)

01958621: 2023-09-29T10:32:27:706497 [STREAM_COMPONEN ]I: Target endpoint 'Databricks Lakehouse (Delta)' is using provider syntax 'DatabricksDelta' (provider_syntax_manager.c:894)

01958621: 2023-09-29T10:32:27:719774 [STREAM_COMPONEN ]E: RetCode: SQL_ERROR SqlState: 01000 NativeError: 0 Message: [unixODBC][Driver Manager]Can't open lib 'Simba Spark ODBC Driver' : file not found [1022502] (ar_odbc_conn.c:584)

01958621: 2023-09-29T10:32:27:719788 [STREAM_COMPONEN ]E: Cannot connect to Cloud server [1022501] (cloud_imp.c:3918)

01958621: 2023-09-29T10:32:27:719790 [STREAM_COMPONEN ]E: Failed prepare Cloud component [1022501] (cloud_metadata.c:239)

Thanks,

Said Sayyad

[nareshkumar]

Thank you for the confirmation...

In order to check isql with DSN .. what are all the parameters to be part of DSN file .. we are using Token in the Replicate endpoint...

We are in Linux platform... Please help us in sharing sample parameters to setup a DSN in odbc.ini file ...

For AS 400 we are passing like below 
[CAMS]
Description = DSN for CAMS.TMS.TOYOTA.COM
Driver = IBM i Access ODBC Driver
System = camsdb.localhost
SSL=1

For DB2 as follows:

[DSN_TRG]
Description = DSN for DB2 cp1fa.vipa.tmm.toyota.com
Driver = IBM DB2 ODBC DRIVER

Please help us with Databriks Lakehouse(Delta DSN ) details ...

[DSN_DELTA]
SSLTrustedCertsPath=/opt/simba/spark/lib/64/databriks.pem
SSL=1
UseSystemTrustStore=1

[john_wang]

Hello @nareshkumar ,

With the Simba ODBC installed on Linux machine, there is an "odbc.ini" sample file under "/opt/simba/spark/Setup", you may copy it to "/etc/odbc.ini" and modify it to fit your needs. Eg:

1. Create an ODBC DSN for the Databricks ODBC Driver

2. or Create an ODBC DSN for the Databricks ODBC Driver

3. Download V2.6.26 64-bit which contains a detailed doc: Simba Apache Spark ODBC Connector Install and Configuration Guide.pdf

Hope this helps.

John.

[SushilKumar]

Hello Team,

IN such case. we would request you to Engage PS via AM as Such new task implementation comes under PS 

More information about the process:

https://community.qlik.com/t5/Knowledge-Base/How-and-When-to-Contact-the-Consulting-Team/ta-p/171493...

Hope this helps.

Regards,

Sushil Kumar