Load more data in app

[Martin22]

Hi all,

In short, I would like to know if there is something we can do to load more data in a Qlik Sense app.

I know we can make some gains by aggregating data, or using QVD files, but I would like to know if there is something to do to go beyond the 10 GB limit of this error message :

Connector reply error: SQL##f - SqlState: S1000, ErrorCode: 35, ErrorMsg: [Simba][Hardy] (35) Error from server: error code: '0' error message: 'Error running query: org.apache.spark.SparkException: Job aborted due to stage failure: Total size of serialized results of 96 tasks (10.1 GiB) is bigger than spark.driver.maxResultSize 10.0 GiB.'.

Is this limit depending on the performance from the virtual machine where Qlik Sense is installed ? Does boosting the virtual machine will help regarding this limit ? Is there in general something we can do about it ?

Regards,

Martin.

[Andrew_Roy · Accepted solution]

Yes, it appears this is specific to JVM performance/capability, rather than Qlik.  Here's a reference that could help:

https://docs.microsoft.com/en-us/azure/databricks/kb/jobs/job-fails-maxresultsize-exception

[Martin22]

Thanks, it looks like the issue is indeed with the JVM.