topic Re: Qlik cloud with databricks in Data Movement & Streaming

Qlik cloud with databricks

rakeshprasad — Wed, 19 Mar 2025 23:08:30 GMT

hi,

i am trying to ingest data from databricks (SQL).

connection works fine, and i am able to view data on "add data" popup screen.

small data i am able to ingest.

but when i am trying to ingest data which is 10million Rows in size (27 columns). I am getting following error.

On Databricks sql log, i could see query completed with no error.

ERROR [HY000] [Qlik][Hardy] (35) Error from server: error code: '0' error message: 'org.apache.spark.sql.catalyst.expressions.UnsafeRow cannot be cast to org.apache.spark.sql.Row'.

Re: Qlik cloud with databricks

Gabor — Wed, 24 Aug 2022 12:09:40 GMT

Same thing happened to me, the app just worked fine yesterday, now it's broken.

Re: Qlik cloud with databricks

Vinay_B — Thu, 25 Aug 2022 04:09:12 GMT

Hi @rakeshprasad,

The error seems to be coming from the driver and doesn't look like a sizing issue, but a specific row that's throwing the error.

I will check on this and let you know.

Re: Qlik cloud with databricks

Vinay_B — Mon, 29 Aug 2022 14:16:49 GMT

Hi @rakeshprasad,

The issue might be with the data. Driver logs could help to understand the issue better. I would recommend checking in Qlik Sense Desktop which is available for free to Cloud users.

Also, it would be better to raise a case with our support team to investigate the issue.

Vinay

Re: Qlik cloud with databricks

Vinay_B — Fri, 02 Sep 2022 15:33:31 GMT

Hi @rakeshprasad,

Is there an update on this issue?

Thanks!

Re: Qlik cloud with databricks

rakeshprasad — Fri, 02 Sep 2022 15:45:44 GMT

Issue is not with data. We are using exact same data in local Qlik (installed on unix servers).

we have raised it with product team.

seems to be some issue with Databricks connector.