Does Qlik Apache Spark connector support connections to Apache Spark on Databricks?

Andreas_Giesbrecht — Tue, 10 May 2022 19:17:46 GMT

Qlik users may report the following example error when trying to select data from an Apache Spark on Databricks connection via Qlik Apache Spark connector (from the Qlik ODBC connector package):

ERROR [42000][Qlik][Hardy](80)Syntax or semantic analysis error thrown in server while executing query. Error message from server: Error running query

See image:

When using an ODBC system DSN based on a third party driver, the issue does not occur.

Cause:

The Qlik Apache Spark connector in older releases of Qlik Sense does not support connections to Apache Spark on Databricks because Databricks Spark has its own standards which are different from "regular" Spark.

This feature was introduced in May 2021 in Qlik Sense on-premise and in the beginning of February in Qlik Sense SaaS and Business. See What's new in Qlik Sense May 2021.

Environment:

Re: Does Qlik Apache Spark connector support connections to Apache Spark on Databricks?

shaun_lombard — Wed, 16 Jun 2021 01:35:40 GMT

Is this now available on Qlik Sense on-premise in May 2021?

Re: Does Qlik Apache Spark connector support connections to Apache Spark on Databricks?

Sonja_Bauernfeind — Tue, 13 Jul 2021 10:34:33 GMT

This was made available in May 2021. I updated the article accordingly.

All the best,

Sonja

article Does Qlik Apache Spark connector support connections to Apache Spark on Databricks? in Official Support Articles

Does Qlik Apache Spark connector support connections to Apache Spark on Databricks?

Cause:

Environment:

Re: Does Qlik Apache Spark connector support connections to Apache Spark on Databricks?

Re: Does Qlik Apache Spark connector support connections to Apache Spark on Databricks?