topic Re: Qlik Sense Performance in general in Management & Governance

Qlik Sense Performance in general

Wed, 17 Aug 2016 11:51:49 GMT

Hi everyone

To increase our Qlik Sense Server's Performance, I thought it was a good idea to increase CPU cores and RAM.

Also in the Operations Monitor (see image below), our CPU usage was at a Maximum this August with 90%.

Our RAM usage also often has been at 80% + and from time to time our Server crashed. So I asked our IT to increase CPU and RAM, but they told me it wouldn't help anything: Their measures say that max CPU usage in August was at 38% and max RAM usage at 86%.

So my questions are:

What Kind of usage is the max CPU usage in Operations Monitor? Shouldn't it be the same number as the one our IT delivered?

And whatever number it is: Can't more CPU cores increase Qlik Sense's Performance anyway?

And what about RAM?

I'm really no Computer Hardware specialist and hope you can help me with That less Information given.

Best regards

Michael

Re: Qlik Sense Performance in general

gainkarthi — Wed, 17 Aug 2016 19:50:51 GMT

Hi Michael,

Can you share the CPU and RAM numbers please.

Regards,

Karthik

Re: Qlik Sense Performance in general

Thu, 18 Aug 2016 06:58:23 GMT

Hi Karthikeyan

Sure, RAM: 16GB, CPU: "Intel(R) Xeon(R) CPU-E52650 v3 @2.30GHz (4 CPUs)" whatever this means 😉

Regards

Michael

Re: Qlik Sense Performance in general

gainkarthi — Fri, 19 Aug 2016 00:25:50 GMT

Hi Mike,

16 GB is very low. Need Number of Cores information also can you share the OS information please.

Re: Qlik Sense Performance in general

Fri, 19 Aug 2016 06:16:31 GMT

Hi Michael,

Can you please tell me , what is the size of data ,second what kind of performance you are talking about, like loading application on browser and all ?

Re: Qlik Sense Performance in general

Fri, 19 Aug 2016 07:21:50 GMT

Hi Karthikeyan

OS is Windows Server 2012 R2

Number of Cores:

In Task Manager it says 4 sockets and 4 virtual cores.

thx

Re: Qlik Sense Performance in general

Fri, 19 Aug 2016 07:48:33 GMT

Hi Rohit

In all QVDs together we're storing about 5GB and we evaluate everything directly in this base.

Performance is just everywhere bad: It takes a few seconds to open apps, it takes several minutes to load data from QVDs if there are many line operations/transformations in the load script etc.

So my question is basically if you think more RAM/CPU cores could help.

Thanks!

Re: Qlik Sense Performance in general

marcus_sommer — Fri, 19 Aug 2016 08:52:01 GMT

Quite probably could you get near the limits of your environment and/or maybe touch it sometimes by round 5 GB on qvd-data and only 16 GB RAM.

I think the statements from your IT aren't quite correct than many load-statements and gui-calculations are fully multi-threaded so that AFAIK it must be 100% of CPU consumption quite often. A RAM consumption of 86% (if it's really the truth) is a bad sign than it meant that there nearly no reserves left and at least the OS will swap their RAM heavily within the virtual RAM on the HD.

If this swapping happens with QLIK it will be very slow and what you described fits in this pattern. I'm not sure how qlik sense certain server settings handled but I think it will like qlikview have some working set settings - which control the min/max values of used RAM and further configurations how many cores are in use and some more.

Another point which might help (and which is often possible) is to optimize the datamodel and the gui.

- Marcus

Re: Qlik Sense Performance in general

Fri, 19 Aug 2016 13:43:49 GMT

Thanks for your Response, Marcus!

Will have a more detailled look at it together with our IT.

Regards

Michael

Re: Qlik Sense Performance in general

Mon, 22 Aug 2016 04:58:50 GMT

Hi Michael,

Few points below which can help you to improve performance :

1. 3-tier Architecture

2. data model with best practices.

3. Try to avoid joins as much as you can , try to make a flat file at DB then connect to it and create QVD with every table.

4. I don't think for 5 GB data 16 GB is less.

Re: Qlik Sense Performance in general

Mon, 22 Aug 2016 07:30:42 GMT

Thank you Rohit! Will follow them as much as I can.

Regards

Michael

Re: Qlik Sense Performance in general

Mon, 22 Aug 2016 11:59:23 GMT

Hi Michael,

If you need My assistanc to explain any specific point, please say to me , I'll do instantly

Re: Qlik Sense Performance in general

Mon, 22 Aug 2016 13:43:43 GMT

Hi Rohit, very Kind of you!

My questions are:

With "try to make a flat file at DB" in Point 3 I guess you're talking from the real database? because I have no create table rights I wouldn't be able to do so.
Also to the join Topic: Can ou tell me when it's more recommended to use a left join instead of a normal load with a where exists condition?

Thanks in advance

Greets

Michael