topic Spark ODBC Connector connects but does not identify my databases in Connectivity & Data Prep

Spark ODBC Connector connects but does not identify my databases

MikePheysey — Tue, 08 Mar 2022 15:22:45 GMT

Hello all,

On QS Nov 2021 I am trying to connect to a Spark Thrift server ( Spark 3.1.1 ) running in Kubernetes. I am able to test and establish a SASL Username only connection using both the Apache Spark ODBC Connector and the Databricks Connector, however when I access the saved connection in the Data Load Editor and open the Select Data to load dialog, the database I specified in the connection does not show up in the drop down of owners, and none of my tables are visible.

When I open the Select Data To Load, I see an exception in the thrift server logs : '[WARN ] got exception trying to get groups for user <my_user>: id '<my_user>': no such user id: '<my_user>': no such user.

I have installed the Simba Spark ODBC driver separately and configured a System ODBC DSN using the same username, host, port and authentication options and my Qlik ODBC data connection using this DSN works just fine.

Has anyone encountered something similar and found a solution?

Re: Spark ODBC Connector connects but does not identify my databases

Francisco_Fernandez — Fri, 18 Mar 2022 16:13:35 GMT

Hi @MikePheysey ,

Could you please provide a screenshot of the error message?

Re: Spark ODBC Connector connects but does not identify my databases

MikePheysey — Mon, 21 Mar 2022 17:57:04 GMT

Hello @Francisco_Fernandez . Here is a screen shot of the thrift logs at the time I attempted to view tables using the built in Apache Spark connector. I have a lot more shots and logs as I was getting ready to open a support issue before trying the community first 🙂

Re: Spark ODBC Connector connects but does not identify my databases

Francisco_Fernandez — Wed, 23 Mar 2022 12:20:08 GMT

Hello @MikePheysey ,

Yes, I would suggest that you open a case since we would need to reproduce this.

Best regards,

Francisco