Load more data in app

Martin22 — Wed, 07 Sep 2022 11:29:11 GMT

Hi all,

In short, I would like to know if there is something we can do to load more data in a Qlik Sense app.

I know we can make some gains by aggregating data, or using QVD files, but I would like to know if there is something to do to go beyond the 10 GB limit of this error message :

Connector reply error: SQL##f - SqlState: S1000, ErrorCode: 35, ErrorMsg: [Simba][Hardy] (35) Error from server: error code: '0' error message: 'Error running query: org.apache.spark.SparkException: Job aborted due to stage failure: Total size of serialized results of 96 tasks (10.1 GiB) is bigger than spark.driver.maxResultSize 10.0 GiB.'.

Is this limit depending on the performance from the virtual machine where Qlik Sense is installed ? Does boosting the virtual machine will help regarding this limit ? Is there in general something we can do about it ?

Regards,

Martin.

Re: Load more data in app

Andrew_Roy — Thu, 08 Sep 2022 18:15:04 GMT

Yes, it appears this is specific to JVM performance/capability, rather than Qlik. Here's a reference that could help:

https://docs.microsoft.com/en-us/azure/databricks/kb/jobs/job-fails-maxresultsize-exception

Re: Load more data in app

Martin22 — Fri, 09 Sep 2022 12:48:41 GMT

Thanks, it looks like the issue is indeed with the JVM.

topic Load more data in app in Connectivity & Data Prep

Load more data in app

Re: Load more data in app

Re: Load more data in app