Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello Team,
we are using Databricks Lakehouse (Delta) as a target. while setup connection we are observing below error.
we tried to uninstall & re-install Simba Sparks driver version simbaspark-2.6.26.1045-1.x86_64.rpm. we also updated Simba file but still facing same error.
Update file /opt/simba/spark/Setup/odbcinst.ini
Add lines :
# Driver from the SimbaSparkODBC-2.6.29.1049-LinuxRPM-64bit package
# Setup from the unixODBC package
[Simba Spark ODBC Driver]
Description = Simba Apache Spark ODBC Connector (64-bit)
Driver = /opt/simba/spark/lib/64/libsparkodbc_sb64.so
Test connection Error:
Logfile error:
Hi John,
We tried the steps placed but still facing the same error #
tried with both :
[Simba Spark ODBC Drivert]
Description=Amazon Hive ODBC Driver (64-bit)
Driver=/opt/simba/spark/lib/64/libsparkodbc_sb64.so
[Simba Spark ODBC Driver 64-bit]
Description=Amazon Hive ODBC Driver (64-bit)
Driver=/opt/simba/spark/lib/64/libsparkodbc_sb64.so
added the internal parameter driver ...
-> also added the paths to site_arep_login.sh:
#Delta Databricks
export ODBCINI=/etc/odbc.ini
export ODBCSYSINI=/etc/odbc
export SPARKINI=/etc/simba.sparkodbc.ini
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/simba/spark/lib/64/libsparkodbc_sb64.so
Copied simba.sparkodbc.ini file to /etc location
restarted the services but still getting the same error .. Please help me.
Hello @nareshkumar ,
Noticed the line:
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/simba/spark/lib/64/libsparkodbc_sb64.so
This is inaccurate as we only need the DLL folder name rather than the DLL file name. Please change it to:
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/simba/spark/lib/64/
Hope it works for you.
John.
Thank you So much for quick response and tried updating the export path to
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/simba/spark/lib/64/
sourced siterep file and restarted the service and still getting the same error.
Hello @nareshkumar ,
Let's make things simple. Please use the "isql" command to troubleshoot the ODBC DSN connectivity issue rather than doing that in Qlik Replicate.
Let's try below steps:
1. Change to use "attunity" (or other account which you choosed)
2. make sure "/etc/odbcinst.ini" is there and configured correctly
3. make sure "/etc/odbc.ini" is there and configured correctly
4. run "source ./arep_login.sh"
5. run "isql" command to access the DSN. If the unixODBC is not installed or not configured correctly, please follow the steps to install it (by root or other privileged account).
In general this error is out of Qlik Replicate, if isql works then Replicate should work too.
Regards,
John.
Hello team,
If our response has been helpful, please consider clicking "Accept as Solution". This will assist other users in easily finding the answer.
Regards,
Sushil Kumar
Apologies for the delayed response ...the solution not working for us .. in previous reply from John it is stated that it is out of replicate . So didn't responded ..
could you please confirm that AWS databriks lakehouse (delta) is supported by Qlik or only Azure will support ?
Hi @nareshkumar
Unfortunately, our documentation does not specify which platform is supported for Databricks Lakehouse Delta. This suggests it is supported for either, but I cannot say with certainty.
Supported target endpoints #Supported target endpoints | Qlik Replicate Help
I'll ask and follow up. We don't have a way to elevate questions/issues to our internal support team via the Community, so we may need a support case for this question.
Thanks,
Dana
In order to check isql with DSN .. what are all the parameters to be part of DSN file .. we are using Token in the Replicate endpoint...
We are in Linux platform... Please help us in sharing sample parameters to setup a DSN in odbc.ini file ...
For AS 400 we are passing like below
[CAMS]
Description = DSN for CAMS.TMS.TOYOTA.COM
Driver = IBM i Access ODBC Driver
System = camsdb.localhost
SSL=1
For DB2 as follows:
[DSN_TRG]
Description = DSN for DB2 cp1fa.vipa.tmm.toyota.com
Driver = IBM DB2 ODBC DRIVER
Please help us with Databriks Lakehouse(Delta DSN ) details ...
[DSN_DELTA]
SSLTrustedCertsPath=/opt/simba/spark/lib/64/databriks.pem
SSL=1
UseSystemTrustStore=1