topic Re: How to properly design concurrent users testing for up to 300 concurrent users? in Scalability

How to properly design concurrent users testing for up to 300 concurrent users?

jblomqvist — Mon, 11 Mar 2019 15:21:36 GMT

Hi,

We have a Qlik Sense environment where we are anticipating up to 300 concurrent users. The idea is to test how our Qlik Sense environment copes with up to this many users at any one time.

How can we appropriately configure a scalability test for handling this many users?

We are going to test on an app that closely resembles the Production environment

The typical user arrival pattern will be:

log in
go to the Everyone stream
open app
"think" time of 45 seconds
select something(could be one to 5 values from a field)
think further for 45 seconds
Navigate to different sheet
Clear selections
Select something else (could be one to 5 values form a field)
"think" time of 45 seconds
Navigate to a different sheet
"think" time of 45 seconds
Select something from another field
"think" time of 45 seconds
Clear selections
Close the app

We want to add 20 users at a time if that's possible with scalability testing? If yes, how to configure it? If no, what is the best way to realistically test loading 300 users for concurrent testing?

Re: How to properly design concurrent users testing for up to 300 concurrent users?

Levi_Turner — Mon, 11 Mar 2019 20:28:40 GMT

Hey @jblomqvist , 20 users at a single point in time is not going to be recommended as there are boundaries (https://support.qlik.com/articles/000044285) at 6 users/second. What I'd do is the following:

Design your scenario
Ramp up time of 2-5 seconds
Go to the Test Scheduler and build a few of these to kick off at once which will get you a higher ramp up (be sure to change the username prefix so you don't have multiple users doing different things with the same userid as you're not trying to test that)

Re: How to properly design concurrent users testing for up to 300 concurrent users?

jblomqvist — Mon, 11 Mar 2019 22:52:59 GMT

Hello Levi,

Useful information! Do you have any recommendations on how I design the test to load up 300 concurrent users? Do I load up 50 tests using the Test Schedular where each test loads 6 users? (300/6 = 50).

Wondering how to get to this number of concurrent users as I have never tested up to this number before.

Re: How to properly design concurrent users testing for up to 300 concurrent users?

Sebastian_Fredenberg — Thu, 14 Mar 2019 12:36:06 GMT

Hi,

I would recommend to not have a higher rampup than 1 new user per second. The boundary of 6/s is to ramp them up (creating them). That boundary is on the product and not on the tools so having more instances that each creates 6/s will not help pushing it further.
That would mean 1 script with 300 concurrent users and RampupDelay of 1 (or preferably higher). You might need to split the script into several parts if 300 is too much for one instance of the tools to handle.

Regards

Re: How to properly design concurrent users testing for up to 300 concurrent users?

jblomqvist — Sat, 16 Mar 2019 17:35:02 GMT

Hi sfg,

Thanks for the info.

Does the above config look OK if I wanted to do concurrent testing for 250 users?

Re: How to properly design concurrent users testing for up to 300 concurrent users?

Sebastian_Fredenberg — Mon, 18 Mar 2019 07:47:58 GMT

Yes that looks like it should run ok. Of course the scenario will impact how it runs (but that looked reasonable too) and you need to have required amount of licenses etc.

Cheers

Sebastian