topic Re: Qlik Sense Scalability Tools in Scalability

Qlik Sense Scalability Tools

Daniel_Larsson — Mon, 19 Dec 2022 09:54:12 GMT

This package (referred to as Qlik Sense Scalability Tools) contains a complete set of tools for easy creation, execution and analysis of load/performance tests.

This tool is now deprecated and will not receive any further updates, please use the Qlik Sense Enterprise Scalability Tools instead.

Supported versions of Qlik Sense: all 2020, all 2021, 2022-aug

Included parts are:

Standalone application for creating and executing a simulation script
Documentation on how to use the package
Regression analyzer
Benchmarking package
App evaluator package

QlikView and Qlik Sense documents to help analyze result and log files (previously included in this package) can be found here :https://community.qlik.com/docs/DOC-15451

Troubleshooting

For help to troubleshoot connection problems, please review Appendix A of the documentation or Connection Troubleshooting Tips

Change log

v5.17.0

Add support for Qlik Sense May 2022 release
Add support for Qlik Sense Aug 2022 release

v5.16.0

Add support for Qlik Sense Feb 2022 release

v5.15.0

Add support for Qlik Sense Nov 2021 release

v5.14.0

Add support for Qlik Sense Aug 2021 release

(See Readme.txt for changes in earlier versions of the tool.)

Your use of Qlik Sense Scalability Tool will be subject to the same license agreement between you and Qlik for your Qlik Sense License. Qlik does not provide maintenance and support services for the Qlik Sense Scalability Tool, however please check QlikCommunity for additional information on use of these products.

Re: Qlik Sense Scalability Tools

korsikov — Thu, 10 Sep 2015 11:41:11 GMT

help me, please.

i'm read manual for QC RA

2. Copy needed log files from their original places and put them into the correct locations under
the <Test Root> folder structure.

we have:

Archived Logs = c:\ProgramData\Qlik\Sense\Repository\Archived Logs\

EventLogs = ???

ServerLogs ==??

SessionLogs = ?? maybe 'c:\ProgramData\Qlik\Sense\Log\Engine\QS_Session_Engine.txt'

Re: Qlik Sense Scalability Tools

lse — Thu, 10 Sep 2015 11:52:42 GMT

Hi, Alexander.

The folder structure, used for this tool, is the same as the QlikView Scalability Tool. Tests performed with both tools could be analyzed with the same version of the QVD Generator and Analyzer.

The EventLogs and SessionLogs folders are reserved for QlikView11-logs so if you are using the Qlik Sense Scalability Tool then you do not have files to put in these folders.

ServerLogs are for Performance Counters generated with Windows PerfMon and the xml-template provided with the tools.

/lars

Re: Qlik Sense Scalability Tools

korsikov — Fri, 11 Sep 2015 08:17:12 GMT

Re: Qlik Sense Scalability Tools

lse — Fri, 11 Sep 2015 08:58:55 GMT

I suspect your simulation-machine and Qlik Sense-machine have different time zone settings in Windows or the machine names does not match.

Different time zone settings will put the test and the performance counters in different time zones and the alignment does not meet the criteria of the where-clause. Note the where-clause is using a key that both include the timeslot and the machinename.

Having this alignment problem will cause problems when analyzing. Make sure all machines are synchronized in time and time zone and re-run the tests.

PCDummy is a field in a staging table used for concatenating all found performance counter qvd's.

The reason for the where-clause is so analysis over long periods of time, with Performance Counters for the full time frame, can be performed without loading millions of rows. It is there to ensure alignment and lower the data volume but if you are careful when analyzing then you can still use the data.

Currently these qvw's do not support or handle Performance Counters and Qlik Sense Scalbility Tool simulations to be logged in different time zones.

If your problem is the machine name, then you will need to use the TestLogMeta-file to connect the simulation to the Performance Counters. A simulation normally use full domain name and Performance Counters use the Windows Machine name. This is step #5 in the Quick Start on page 1 and in more details on page 4 of the "User Guide for SC Result Analyzer.pdf".

/lars

Re: Qlik Sense Scalability Tools

korsikov — Fri, 11 Sep 2015 09:29:05 GMT

Thanks for the tip.

I originally suggested that the reason in a different host name in the logs

For hostname QSDEMO in the settings file have the same name, but the logs are fully qualified domain name of the connection qsdemo.myhost.com

time zone a same in all hosts. All hosts is part one windows domain.

Re: Qlik Sense Scalability Tools

Mon, 21 Sep 2015 09:49:49 GMT

Hi Daniel,

I download this tool and trying to install, but it is not installing and generating an error "Qlik Scalability Tool has stopped working".

Is there any specific steps needs to be follow before installing the tool ? I'm using Qlik Sense 2.1 version and windows 7 64-bit OS.

Re: Qlik Sense Scalability Tools

Daniel_Larsson — Mon, 21 Sep 2015 10:42:44 GMT

Did you follow the note above?

Note: Using windows built-in unzip functionality will not allow the .exe to launch unless unblocking zipped package first (properties -> unblock).

When downloading any zip file from the internet windows will unfortunately block it as a "security" measure. If the the zip file is not unlocked prior to unzipping the exe-file will be blocked from executing producing an error as the one you describe. Unblocking the zip file or unzipping it with a third party tool such as 7-zip (http://www.7-zip.org/a/7z1507-x64.exe‌) should solve the problem for you.

Re: Qlik Sense Scalability Tools

Mon, 21 Sep 2015 11:15:23 GMT

Thank you Daniel, it worked !

Re: Qlik Sense Scalability Tools

Tue, 22 Sep 2015 06:29:57 GMT

thanks for sharing

Re: Qlik Sense Scalability Tools

Fri, 19 Feb 2016 18:27:34 GMT

Hello Daniel,

I downloaded the Qliksense scalability tool , and installed it on the development server which is a standalone box. We have server setup with the proxy .Is this the information that needs to be used while using the tool or do we setup a separate proxy for testing ? As , when I try to connect to the app using Appstructure Connect to App, I get an error saying Failed to connect to app.We are using Qliksense 2.0.3 version.

Re: Qlik Sense Scalability Tools

Daniel_Larsson — Mon, 22 Feb 2016 08:47:25 GMT

I have don't understand completely how your machines are setup, but I think I understand it as you have a machine which is not included in the test and want to test against a different server, correct? In that case so far so good since running the tool and sense on the same server might have them contend for resources, thus affecting the test.

When you get a connect fail it is usually a settings problem.Some things to verify

Does the the user simulated have access to the app? If you are using header auth, make sure the virtualproxyprefix and the headername are set to the ones you defined in the qmc. Also test a header user manually using e.g. modify headers plugin in firefox, fiddler or similar. For different header users to be able to connect the app must be published.
Make sure what you put in "server" is the hostname only, shortname is fine if the machines are on the same domain, otherwise fully qualified named
If you use ssl unchecked, make sure you have enabled "allow http" in the proxy setting in the qmc.
If above two fails, try accessing with NTLM, (removing the virtualproxyprefix or changing to the one where you have NTLM auth).

Re: Qlik Sense Scalability Tools

Wed, 24 Feb 2016 02:37:29 GMT

Thank you Daniel for responding back.

I followed the steps to setup the header authentication in QMC, and while I am testing the virtual proxy using Mozilla I get an error saying"Could not authenticate the request .Expected Authentication header" even after adding the header.

Re: Qlik Sense Scalability Tools

Sebastian_Fredenberg — Wed, 24 Feb 2016 10:57:13 GMT

Hi,

It sounds like the the header is not enabled in your browser, or the plugin itself is not running. With modify header plugin, the enabled headers are displayed with a green dot.The plugin icon should be red and read "Stop" if it is running. See below:

Re: Qlik Sense Scalability Tools

Wed, 24 Feb 2016 20:20:04 GMT

Thank you Sebastian.

Changing the Connection type to NTLM did the trick.

Re: Qlik Sense Scalability Tools

Daniel_Larsson — Thu, 25 Feb 2016 10:34:36 GMT

So this means the settings for header auth where not correctly setup either in tool (virtualproxyprefix etc) or in qmc.

Be aware that if you do simulate using the NTLM option, all users will connect to the proxy using the same user as the one running the tool. This means from proxy perspective and license handling, auth etc everything will be handle as this user. From engine perspective the tool will make sure to use independent session which does not affect each other however. Thus running multiple users with the NTLM setting would not make a big difference for exercising the engine, but it will make a difference in how repository and proxy is exercised. This is why header auth is recommended during the load test.

That said, it still might be enough for you depending on you purpose.

Re: Qlik Sense Scalability Tools

mountaindude — Fri, 22 Jul 2016 05:28:55 GMT

Having issues similar to the above ones, getting a "Failed to get app structure: Failed to to connect to app. Error: Failed to connect to application" when doing an "App strcture... Connect to app".

Have tried both header auth and NTLM. No luck getting the app structure.

The interesting part however is that if I have a single "Clear all" in the script, it runs just fine without errors... But when adding a "select" to the script, I of course need to tell what field I want a selection made in, and for that to work we need info on app structure - which consistently fails.

For example, here is the execution log for a simple script that has a single action "ClearAll" (URL has been changed below).

Starting test towards Uri: wss://<my URL>/loadtest

05:40:37 Workers:0 Errors:0 Warnings:0 Requests:0

Test Execution Finished.

WarningCount: 0

ErrorCount: 0

Finishing writing logs...

The script looks like this:

Have tried connecting using custom headers in Firefox, works fine.

The requirement talks of .Net 4.5.2 requirement. I am on Windows Server 2012 R2, .net 4.6.1.

Could that be it?

Been looking through the Sense log files without finding any real info on what's happening when the App structure request fails.

Ideas?

Re: Qlik Sense Scalability Tools

Daniel_Larsson — Fri, 22 Jul 2016 09:37:55 GMT

Hi,

.Net 4.6.1 should be 4.5.2 compatible so this should no be the issue.

In worst case scenario, there are some other ways to get the id's, but those are more cumbersome, so first:

Some users have had problem running from network share or having to long paths. I doubt this is the case here, but try putting it locally on the load client with a short path.

I see you use SSL (which actually mean TLS, name is legacy), is it a non self-signed certificate (i.e. you get the green icon in browser), if not, did you get the certificate to the load client according to documentation? If you have the possibility to check "Allow http" in the proxy, can you try to do that and deselect SSL checkbox.

There might be some info on the connect error in the GUI log file, this file is located in the {Tool Root}\Logs folder. Although since your clearAll script works I doubt this would give us much information.

Some other ways to get the id's:

1. Load the app into Qlik Sense desktop and connect to it using connectiontype personal port 4848. Then save the structure to file and use it for your script.

2. If your app contains titles (i.e. show title option checked) you can use a bookmarklet to replace the titles with the object Id’s. Such a bookmarklet can be obtained here: https://gist.github.com/mindspank/17e518f67f674c3caae5 . This will however not work pefectly with all types of filterpanes

3. Use the single configurator in dev-hub to get the id's (will not get id's for listboxes, only the filter pane container which is not the one you select in).

Some other ways that would need more explanation if these still don't work for you:

4. Get structure via command line

5. Using chrome dev tools.

Re: Qlik Sense Scalability Tools

mountaindude — Fri, 22 Jul 2016 11:53:34 GMT

Tried both with and without SSL - same result.

I have tried many variants by now, latest version is using a virtual proxy called "loadtest", linked to a proxy on ServerLab. ServerLab is also listed as the worker node in the load balancing section, so this should be a pretty local setup..

I then access http://<FQDN of ServerLab>/loadtest with custom header, and that works. The ClearAll action from within the Scalability tool also works - get App structure does not. So still the same.

Scability tools is stored in C:\utility_apps\ScalabilityTools, so no weird/long paths.
I execute the EXE from that directory while RDP:d into ServerLab.

All in all, I don't think any request ever leaves the ServerLab machine...

Oh btw, I created a small app called "Loadtest", which just includes the Ctrl-0-0 test script. Nothing fancy there thus.

I have a setup that every day dumps all metadata for all apps to a QVD, I can pull the needed IDs from there. Will give that a try.

Re: Qlik Sense Scalability Tools

Daniel_Larsson — Fri, 22 Jul 2016 12:20:51 GMT

Ok, not much to add, I think this is quite weird that it doesn't work, the differences between executing directly are quite few.

Just to make sure, since the behavior is very different in different environments and especially considering windows versions. In some environments it's possible to run the gui and even execute some things even though a blocked zip was used, in others it crashes directly. So can you make sure the zip was unblocked before unzipping it? If you don't remember if you did this or not, just retry unblock followed by unzip in a different location (not to mess with saved scenario etc.). Blocking of the zip is unfortunatly a windows thing and not much we can do about. If you unzipped with i.e. 7-zip it will automatically unblock for you, so in that case this is not the issue.