Qlik Community

Qlik Scalability

A group dedicated to advancing Qlik scalability and performance. In this group we will share knowledge on how to perform load tests of Qlik products.

Partner
Partner

Re: Qlik Sense Scalability Tools

Thank you very much.
Good tool. I'll take it in use.
I need to determine how much CPU is needed for 1000 concurrent users. How do I properly perform load testing and determine enough CPU?

Luminary
Luminary

Re: Qlik Sense Scalability Tools

It's really, really difficult to do accurate simulations or estimates for
what you are describing.

For example, let's say you configure Scalability tools to simulate 1000
concurrent users (which will be a challenge in itself! Not to mention
you'll need Sense licenses for 1000 concurrent users..)
You then have to make sure your 1000 test users access Sense apps similar
to those you will have in the prospective/real system.
I mean, 1000 concurrent users that ALL access A SINGLE, SMALL app will not
require much in terms of servers.
On the other hand, 1000 concurrent users accessing 500 DIFFERENT, LARGE
apps will require lots and lots of big Sense servers.

I'd recommend to start off by making sure you have representative test apps
in a Sense server dedicated for this testing purpose.
Then start throwing 10 users at the Sense server, observe how much CPU, RAM
etc is needed.
Then 100 users - observe CPU/RAM/... needs
Then 500 users, then 1000.
Most likely you will run into various issues along the way. Work
around/solve them, then move on to higher user volumes.

Partner
Partner

Re: Qlik Sense Scalability Tools

We have trial licenses Qlik Analytics Platform for several variations of cores CPU.
We also have already developed applications.
Using Scalability Tools, we indicate 1000 users. Defined application testing scenarios. However, there is a suspicion that during subsequent user connections, the previous ones simply hold the connection, and the new user runs the script. It turns out that the simultaneous execution of the script by all users does not occur.

Employee
Employee

Re: Qlik Sense Scalability Tools

How long is your scenario and what is your Iterations parameter set to? The number of specified users will be kicked off at a pace determined by the RampupDelay, and each execute the specified number of iterations of the scenario. This means that if the scenario is sufficiently short and iterations low, it may be the case that the first user is done with the scenario before the last user even enters the simulation. Upping the iterations value allows you to prolong the scenario by looping it.

Highlighted
Partner
Partner

Re: Qlik Sense Scalability Tools

Thank you very much.
We apply your recommendations.

Partner
Partner

Re: Qlik Sense Scalability Tools

Is there any plan to support TED certified extensions like Vizlib filter and table objects?

Employee
Employee

Re: Qlik Sense Scalability Tools

Hi,

No there's no current plan to add official support for such extensions other than the semi-support already existing, i.e. we do a "GetLayout" for each extension object.

For some extensions the Qlik Sense Enterprise Scalability Tools might help, as it supports adding your own request flow for any extension provided it's of a simpler form (i.e. no sessionobjects, no navigation and no advanced logic like auto adding selections etc). If this is enough for your use-case you can read about it in the section "Supporting extensions and overriding defaults".

mwallman
Contributor II

Re: Qlik Sense Scalability Tools

Hi there,

I have the 5.2.0 version of the tool as well as 5.5.1.

We use Qlik Sense April 2018 version in a two node environment.

Would there be any benefit in using 5.5.1 version of the tool compared to 5.2.0?

It might sound like a silly question but I have used 5.2.0 for this version before in our environment so wondering whether to stick to this version, or use the new one.

Employee
Employee

Re: Qlik Sense Scalability Tools


@mwallman wrote:

Hi there,

I have the 5.2.0 version of the tool as well as 5.5.1.

We use Qlik Sense April 2018 version in a two node environment.

Would there be any benefit in using 5.5.1 version of the tool compared to 5.2.0?

It might sound like a silly question but I have used 5.2.0 for this version before in our environment so wondering whether to stick to this version, or use the new one.


If you are using Sense April 2018 there's no strict reason for you to move to 5.5.1. The 5.5.1 version still includes support for April 2018 though. You will be missing out on some bugfixes mostly and somewhat more correct handling of boxplot autocharts (Chart suggestion), but as autocharts  are not fully supported and the recommendtion is to turn these off for proper test result that shouldn't make a difference.

mwallman
Contributor II

Re: Qlik Sense Scalability Tools

Hi all,

I am looking to do 350 concurrent user testing on 3 dashboards.

App sizes:

  1. One is a 3.5GB app
  2. The other two are around 500MB and 800MB in size.

Is it possible to run multiple tests at once using the tool where all of these apps are being consumed at once by a total of 350 concurrent users?

E.g. I want to split the test so there are 150 concurrent users on the 3.5GB app, 100 users on 500MB app, and 100 users on 800MB app concurrently all at the same time.

They are different dashboards so there are different scripts for it.

How much should I set my ramp-up delay to for something like this?

And Iterations value?

And ExecutionTime?

Any advice on how best to set up a test like this?