topic Re: QV Scalability Tools (QV10,QV11,QV12) in Scalability

QV Scalability Tools (QV10,QV11,QV12)

Daniel_Larsson — Thu, 24 Feb 2022 09:04:41 GMT

This package (referred to as QVScalabilityTools) contains a complete set of tools for easy creation, execution and analyzing of load/performance tests and regression tests.

QlikView documents to help analyze result and log files(This was previously included in this package):Scalability Results Analyzer

Older versions of the tool can be found here: Tool for easy creation of load/performance tests of QlikView (v.10 and 11)

Tools for Qlik Sense can be found here: Qlik Sense Scalability Tools

Note: Using windows built-in unzip functionality will not allow the .exe to launch unless unblocking zipped package first (properties -> unblock).

Note: Regarding Apache Log4j, reference CVE-2021-44228 (also referred to as Log4Shell), these set of tools are not directly vulnerable to the exploit, however JMeter, the tool required as a separate download, is. How to mitigate the vulnerability for JMeter has been documented here : https://community.qlik.com/t5/Knowledge/Qlik-Scalability-tools-and-log4j/ta-p/1872009

Included parts are:

Standalone application for creating a JMeter script
Support files for launching the script by utilizing the JMeter engine (JMeter installed is a pre-requisite)
Documentation on how to use the package

Version 1.2.7->1.2.8

Changes Section Access requests

Changelog 1.2.6->1.2.7

NTLM support removed due current solution broken and lack of a new secure solution.
Small updates for static content, for future product releases.

2019-08-26

Documentation updates due to:
- New recommended JMeter version (4.0)
- Changes to the licensing for the Oracle Java implementation (seehttps://www.oracle.com/technetwork/java/javase/overview/oracle-jdk-faqs.html)
- Open-source Java Development Kits (JDKs) have been verified for use with JMeter and the QlikView Scalability Tools

Changelog 1.2.5->1.2.6

Added support for QlikView 12.50 and 12.20SR10

Changelog 1.2.4->1.2.5

Added support for QlikView 12.30

Changelog 1.2.3->1.2.4

Added support for JMeter 4.0 and Java 9.
Bugfixes for regression testing
Added actions: Select Excluded, Select All, Select Possible
Added support for 12.20 SR3

Changelog 1.2.2->1.2.3

Bugfix for export to excel action
Added transfer state (bookmark) support for document chaining
GUI: Template selection more accurately show supported Qv versions

Changelog 1.2.1->1.2.2

Bugfixes, make sure minimum amount of selections are respected in certain corner cases

Changelog 1.2->1.2.1

Improved performance for high throughput scenarios

Changelog 1.1 -> 1.2

Improved assertions logic to show faulty actions as errors
Change JMeter template scripts to use groovy instead of beanshell
New prerequisites:
- JMeter version 3.0
- Java 64-bit JRE 8

Your use of QVScalabilityTools will be subject to the same license agreement between you and QlikTech for QlikView Server. QlikTech does not provide maintenance and support services for QVScalabilityTools, however please check QlikCommunity for additional information on use of these products.

PLEASE NOTE:

The supported versions of Java are 8 and 9. Supported version of JMeter are 3.0 and 4.0, but not 3.2

Re: QV Scalability Tools (QV10,QV11,QV12)

Wed, 25 Jun 2014 20:01:38 GMT

So I'm running the scalability tool, I have setup the data collector, but when I generate my script, and execute it. Then create the QVD's and read those I find that the it doesn't appear that the data collector is getting the cpu or ram usage stats. I'm using the template included also. Anyone have any suggestions?

Re: QV Scalability Tools (QV10,QV11,QV12)

Mon, 30 Jun 2014 20:33:28 GMT

So I'm using version 8 here and I just can't get it to work. The tests run, I get the log files, I can create the qvd's and look at the stats, the problem is that none of the performance stats really load. I don't get cpu or ram usage stats and I think the reason for this is, is because the following info doesn't get filled in: QVS_Servername, QVS_Cores, QVS_Ram, QVS_Ram_Min%, QVS_Ram_Max%, %Key_ServerName, cores, ram, RAM_Min%, Ram_Max%,

Where do these get pulled from? I look at the performance logs and I see that stats are being pulled, but not in the qvw.

Any help would be greatly appreciated. I do have a zip file of everything so if you would like to review it please let me know. Though it is nice to see the response times, what I really need is the cpu and ram usage stats.

Re: QV Scalability Tools (QV10,QV11,QV12)

Alejandro_Hernández — Mon, 30 Jun 2014 21:13:07 GMT

Jeremy,

Are you following these steps?

Collect information about the machines used

Open the ServerMetaFetcher.qvw and enable Macro. Add all IP addresses or machine names, for all machines used in the testing, to the table. Click the "Fetch Properties"-button. Check the details table to ensure that everything is collected. Make sure that the WorkingSet-limits should be set according to the settings in QEMC->System->Setup->Performance for the machines, as these are defaulted to min 70 and max 90 and not read from the server.

Click the "Export ServerInfo"-button. This will save an xml file, called ServerInfo.xml, adjacent to ServerMetaFetcher.qvw.

Re: QV Scalability Tools (QV10,QV11,QV12)

Mon, 30 Jun 2014 21:44:42 GMT

I have used that, I have enabled macros in the Management Console. The issue I have is that I put down the following IPs/servernames (localhost, 127.0.0.1, mcqkvwwap001, 64.54.35.125. These all deal with one server as the web server and qlikview server are on the same machine and I'm running my tests on that machine. When I click fetch properties only localhost and 127.0.0.1 get filled in with data, not the servername or external ip address.

Now when you say enable Macro are you talking on the server side or in the app? If in the app how do I do that?

Re: QV Scalability Tools (QV10,QV11,QV12)

Daniel_Larsson — Tue, 01 Jul 2014 06:50:15 GMT

Jeremy,

Macros needs to be enabled in the QlikView desktop running the ServerMetaFetcher.qvw. Macros can be enabled by clicking allow any in the popup when opening it the first time or by going to Tools->Edit Module and changing Current Local Securiy to Allow System Access.

The metafile can also be created from within the QvScalabilityTools by clicking Tools->Get server info and providing the correct server and output folder in the dialog.

Re: QV Scalability Tools (QV10,QV11,QV12)

Wed, 02 Jul 2014 18:34:00 GMT

Daniel,

Thanks for this, this fixed the issue with not being able to pull the server information. But with this pulled I don't see that my server info xml file is any different then when I just manually added in the hostname and external ip of the server. When I use the QVD generator and SC_Results, I'm still seeing that the server settings are still blank for everything.

Here is what my server info file looks like:

<?xml version="1.0" encoding="utf-8" standalone="yes"?>

<BIOSName>Default System BIOS</BIOSName>

<OperatingSystemName>Microsoft Windows Server 2008 R2 Enterprise |C:\Windows|\Device\Harddisk0\Partition2</OperatingSystemName>

<ComputerName>MCQKVWWAP001</ComputerName>

<ComputerModel>ProLiant BL460c Gen8</ComputerModel>

<ProcessorDescription>Intel64 Family 6 Model 45 Stepping 7</ProcessorDescription>

<ProcessorName>Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz</ProcessorName>

</Details>

<ServerName>localhost</ServerName>

<BIOSName>Default System BIOS</BIOSName>

<OperatingSystemName>Microsoft Windows Server 2008 R2 Enterprise |C:\Windows|\Device\Harddisk0\Partition2</OperatingSystemName>

<ComputerName>MCQKVWWAP001</ComputerName>

<ComputerModel>ProLiant BL460c Gen8</ComputerModel>

<ProcessorDescription>Intel64 Family 6 Model 45 Stepping 7</ProcessorDescription>

<ProcessorName>Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz</ProcessorName>

</Details>

<ServerName>mcqkvwwap001</ServerName>

<BIOSName>Default System BIOS</BIOSName>

<OperatingSystemName>Microsoft Windows Server 2008 R2 Enterprise |C:\Windows|\Device\Harddisk0\Partition2</OperatingSystemName>

<ComputerName>MCQKVWWAP001</ComputerName>

<ComputerModel>ProLiant BL460c Gen8</ComputerModel>

<ProcessorDescription>Intel64 Family 6 Model 45 Stepping 7</ProcessorDescription>

<ProcessorName>Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz</ProcessorName>

</Details>

<BIOSName>Default System BIOS</BIOSName>

<OperatingSystemName>Microsoft Windows Server 2008 R2 Enterprise |C:\Windows|\Device\Harddisk0\Partition2</OperatingSystemName>

<ComputerName>MCQKVWWAP001</ComputerName>

<ComputerModel>ProLiant BL460c Gen8</ComputerModel>

<ProcessorDescription>Intel64 Family 6 Model 45 Stepping 7</ProcessorDescription>

<ProcessorName>Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz</ProcessorName>

</Details>

For server settings, what should or shouldn't be checked. I unchecked "Allow Session Recovery",

Under Logging, I have checked "enable session logging, enable performance logging (1 minute), enable event logging and enable audit logging" Event Log Verbosity = high and split logs daily.

Under the Authentication tab, it is: Allow Anonymous, Anonymous Account = On Local Computer, Authorization = NTFS, Micellaneous checked = allow dynamic data update, allow unsafe macro execution on server, allow extensions, allow macro execution on server and compress network traffic.

Performance working set is 70% and 90%.

Should I be setting my logs to normal logging or debug logging?

I'm still not sure where the server settings get set from and why when I look at SC_Results all of the server settings are blank.

Re: QV Scalability Tools (QV10,QV11,QV12)

Wed, 02 Jul 2014 18:57:34 GMT

Also, should I be having logging turned on, in the app I'm running the test against?

Re: QV Scalability Tools (QV10,QV11,QV12)

Wed, 02 Jul 2014 19:24:50 GMT

Also here is what I am seeing when I reload SC_Results -

RecordTypeJMeter << INLAA97 2 lines fetched

TestGroup << JMeterLogMeta 0 lines fetched

TestServer << JMeterLogMeta 1 lines fetched

JMeterLogs << INLAA98 0 lines fetched

JMeterLogs << ResStudDash baseline_localhost_[1-1-3]_140702120437 735 lines fetched

DocumentUsed << ResStudDash baseline_localhost_[1-1-3]_140702120437_UsedQVWs (qvd optimized) 0 lines fetched

MaxRelativeTime << JMeterLogs 1 lines fetched

PrettyLogFileNames << PrettyLogFileNames 1 lines fetched

Calendar << ResStudDash baseline_localhost_[1-1-3]_140702120437_Cal 52 lines fetched

OpenDoc << DocumentLoad 0 lines fetched

PerformanceCounters_%KEY_TimeSlot << MCQKVWWAP001_Processes20140702-000030 0 lines fetched

ServerInfo << TableBox/Details 0 lines fetched

PerformanceCounters_%KEY_TimeSlot_QVS << MCQKVWWAP001_Processes20140702-000030 0 lines fetched

QVS_ServerInfo << TableBox/Details 0 lines fetched

PerformanceCounters_%KEY_TimeSlot_WEB << MCQKVWWAP001_Processes20140702-000030 0 lines fetched

WEB_ServerInfo << TableBox/Details 0 lines fetched

PerformanceCounters_WEB_TimeSlots << PerformanceCounters_%KEY_TimeSlot_WEB 0 lines fetched

Events << Events 0 lines fetched

QVSEVENTS << Events 0 lines fetched

SessionLog << SessionsLog 0 lines fetched

commentmap << INLB092 163 lines fetched

Appears that it isn't finding any lines for a lot of the counters.

One last thing in looking at the UsedQVWsQVD my QVD is blank, it doesn't have the %KEY_QlikMachineID nor LoadedQVW filled in.

Re: QV Scalability Tools (QV10,QV11,QV12)

Daniel_Larsson — Thu, 03 Jul 2014 06:39:15 GMT

I see that you ran the tool locally instead of using an external load client as per recommendation. Running it locally will obviously affect the test results depending on how heavy the test is, as for a heavier test QlikView engine and JMeter might contend for resources. Running it locally will also not include the response times induced by your IT infrastructure thus being faster than a real user will perceive it. However depending on the purpose of the test it might be just fine.

The problem you are experience now is due to the JMeter log files being named baseline_localhost_[1-1-3]_140702120437. Rename the file replacing localhost with MCQKVWWAP001 and the generator should be able to find lines connected to the test.

Re: QV Scalability Tools (QV10,QV11,QV12)

btrompetter — Tue, 29 Jul 2014 08:14:19 GMT

Hallo,

I try to load the Layout file and get the following error:

2014-07-29 10:10:43;SelectActionsUserControl::LoadDocument;qv.Parser.Xml.QlikViewDocumentXmlParseException: An error occured when loading sheets from QlikViewProject

at qv.Parser.Xml.QlikViewDocumentXmlParserV11SR1.Load(String directoryPathToTopLayout)

at qv.Parser.QlikViewDocumentParserFactory.Create(String documentFolderPath)

at qv.UserControls.SelectActionsWPFUserControl.LoadDocument()

I use Qlikview 11.2 SR7. I didn't have a clue what cause this issue.

How can I solve this problem?

Thanks for help

Bastian

Re: QV Scalability Tools (QV10,QV11,QV12)

Sebastian_Fredenberg — Wed, 30 Jul 2014 12:19:34 GMT

The above is caused by percent an encoded character in the exported Document Layout files, in this case a "." which will be encoded as "%2E".

If this is encountered, check the folder where the document layout was exported and revert the percent encoding to the characters they should represent (see Percent-encoding - Wikipedia, the free encyclopedia) . The document layout files should be able to be read into the scalability tools after this.

Re: QV Scalability Tools (QV10,QV11,QV12)

rajeshvaswani77 — Thu, 28 Aug 2014 10:50:41 GMT

Hi All,

I am using the QV Scalability tool for the first time.

We have SSO for our QlikView Server.

The QlikView Web server has Header authentication.

Can anybody suggest, how I can configure the Header field in the QlikView scalability tool.

I understand the login credentials go in to the usrpwd.txt file.

thanks,

Rajesh Vaswani

Re: QV Scalability Tools (QV10,QV11,QV12)

Fri, 29 Aug 2014 14:42:24 GMT

Rajesh,

On the Properties tab of the Scalability Tool, on the bottom of the page is a section called 'Authentication'. In the lower left you can select "Header" to enable header authentication.

Re: QV Scalability Tools (QV10,QV11,QV12)

rajeshvaswani77 — Mon, 01 Sep 2014 06:12:59 GMT

Thanks Terry,

That worked.

regards,

Rajesh Vaswani

Re: QV Scalability Tools (QV10,QV11,QV12)

rajeshvaswani77 — Mon, 01 Sep 2014 07:22:30 GMT

Hi All,

Using the QV Scalability tool, can we get the load times of the chart object?

We would like to measure the chart calculation time(time taken for an expression to execute).

thanks,

Rajesh Vaswani

Re: QV Scalability Tools (QV10,QV11,QV12)

Daniel_Larsson — Mon, 01 Sep 2014 08:30:11 GMT

The tool will measure the response time for all the objects on a sheet. To find the time for a single object, using the tool, the easiest way is to put it on a separate sheet. Thus the response time would correspond to that object. Do note that this would include network latency etc since it's a simulation.

There's also an option in QV to see calc time for objects. Right-click the tab, choose sheet properties. This is a good approximation of the calculation time, but obviously is highly dependent on if the object is cached etc (will show a very low value when cached, even down to 0),

Using a combination of both these methods should give a good picture of the calculation time. However during development using normal windows task manager, is probably the fastest way to get feedback on the performance of your chart/expression.

Re: QV Scalability Tools (QV10,QV11,QV12)

rajeshvaswani77 — Mon, 01 Sep 2014 09:04:22 GMT

Hi Daniel,

Thanks for the three methods you have suggested.

Last question, If I were to say put a chart object (the more time consuming) in separate sheet.

Would the response time be derived condition to the chart has completely loaded?

thanks,

Rajesh Vaswani

Re: QV Scalability Tools (QV10,QV11,QV12)

Daniel_Larsson — Mon, 01 Sep 2014 09:55:40 GMT

The response will include all factors for response time, e.g. rendering time, network latency etc. These are however negligible and the expression would be the bigger factor. It is still dependent och cache however and time will be faster once it's cached. To make sure to always have the same conditions the engine service should be restarted before a simulation is started.

Re: QV Scalability Tools (QV10,QV11,QV12)

rajeshvaswani77 — Mon, 01 Sep 2014 11:44:15 GMT

Thank you somuch Daniel, that helps.

regards,

Rajesh Vaswani