Does Qlik Apache Spark connector support connections to Apache Spark on Databricks?

[Andreas_Giesbrecht]

Qlik users may report the following example error when trying to select data from an Apache Spark on Databricks connection via Qlik Apache Spark connector (from the Qlik ODBC connector package):

ERROR [42000][Qlik][Hardy](80)Syntax or semantic analysis error thrown in server while executing query. Error message from server: Error running query

See image:

When using an ODBC system DSN based on a third party driver, the issue does not occur.

 

Cause:

The Qlik Apache Spark connector in older releases of Qlik Sense does not support connections to Apache Spark on Databricks because Databricks Spark has its own standards which are different from "regular" Spark.

This feature was introduced in May 2021 in Qlik Sense on-premise and in the beginning of February in Qlik Sense SaaS and Business. See What's new in Qlik Sense May 2021.

Environment:

QlikView 
Qlik Sense Enterprise on Windows 
Qlik ODBC Connector Package 
Qlik Sense Desktop 
Qlik Cloud 
Qlik Sense Business 

[shaun_lombard]

Is this now available on Qlik Sense on-premise in May 2021?

[Sonja_Bauernfeind]

This was made available in May 2021. I updated the article accordingly.

All the best,

Sonja