What happens to QlikSense when loaded with data beyond it's capacity?

[Anonymous]

Hi Qlik Community,

I want to know whether Qlik Sense will prompt a warning sign when the user is trying to load data beyond it's capacity, or the application will just crash. This may help us warn our clients case this incident may happen. I want to try overfeeding data into the system but I don't have large data source to test it, that's why I am wondering if there is anyone that already had this experience or someone who already tried testing QlikSense's capacity.

Regards,

Damien

[kaushiknsolanki]

Dear Damien,

As per my knowledge I dont think its possible to intimate before loading the data whether it will be under capacity or over capacity.

How it works is it loads the data in to RAM while executing the script. So if the script doesn't finish before the RAM is full then it will hang.

Regards,

Kaushik Solanki

[reddy-s]

Hi Damien,

It all depends on the ram size you have, more the data , bigger the ram has to be. There will be performance issues if the ram is small.

Thanks,

Sangram.

[Michael_Tarallo]

Hello Guys,

I will also notify the product team to see if they have discussed something like this.

Please mark the appropriate replies as CORRECT / HELPFUL so our team and other members know that your question(s) has been answered to your satisfaction.

Regards,

Mike Tarallo

Qlik

[Anonymous]

Hi, Damien,

As Kaushik mentioned, If you are in the loading data process, and your memory is not enough for the load, then the Qlik sense process will just hang, without any warning/error, you can not move your mouse any more, which means your system has crashed.

If it is the case when the dash is opening/filtering/selecting in a browser, when it is a Qlikview dash, I have encountered this before, and you will get a warning like memory issue/error in the table, and the table can not be reload anymore because the selection/re-calculation need more memory than the server provide.  But for Qlik sense, I have no idea yet. Maybe some thing similar?  Looking forward for some expert's reply.

Zhihong

[mgranillo]

Damien,

If you want evidence, you could load an app with test script data (press "ctrl, 0, 0" in your script) and change the last while statement to .99999999.  Run the script and watch your memory slowly fill up...see what happens. 

Kaushik is right though, it will just hang.

Mike

[mgranillo]

I just did it and it was interesting.  My memory filled up and Qlik Sense script spun, my memory cleared some stuff out, and then Qlik continued running.  It filled up my memory again and it crashed.  See screen shots.

[Levi_Turner]

The end user experience will be a hang in the UI, but behind the scenes, I would expect the Engine service to crash with an internal inconsistency error. In my environment it was commonly Internal inconsistency, general exception detected (Simple Request), at least in the 2.1.1 environment that I was load testing.

There are very few limits on the Qlik Sense side of things, but when you exhaust available RAM on the server, then the Engine can crash.

[reddy-s]

Adding an other point here:

when ever the ram hits the max, the whole Cache is cleared as well, which will impact the performance as the calculations have to be redone again.