Qlik Sense - How to monitor resources using Microsoft Performance Monitor

[Bastien_Laugiero]

The Microsoft Performance Monitor (perfmon) makes it possible for users to set up automatic data collection jobs which can save data from performance counters at a given interval. This data can, together with Qlik Sense Logs help to analyze Qlik Sense services behavior.
This document describes the steps necessary to save such data using Microsoft Performance Monitor Data Collectors. 

Environment:

• Qlik Sense Enterprise on Windows  

Resolution:

Note1: These include the Qlik Sense specific and some other environmental counters, but not all counters that may apply to different troubleshooting scenarios. (e.g. Networking, disk read write frequency and speed, etc.)

Note2:
Attached to this article you can find an XML template including the counters below with additional disk and network counters. The template file can be imported in Performance Monitor under Data Collector Sets > right-click User Defined > New > Data Collector Set > Create from a template.

Prerequisites:

 - Microsoft Performance Monitor must be installed on Qlik Sense Server
 - The user which initiates the Data Collectors must be at least local admin

Setting up a Data Collector:

1. Open Microsoft Performance Monitor (located under Server Manager > Tools)
2. Open Data Collector Sets in the tree view on the left pane
3. Open User Defined
4. Right-click on User Defined and select New > Data Collector Set
5. Add a value for Name and select option Create manually (Advanced). Click Next
6. Under Create data logs check Performance counter. Click Next
7. Click Add...
8. Expand Processor and select % Processor Time. Make sure that _Total is selected in Instances of selected object:, then click Add >>
9. Expand Memory and select Available Mbytes, and Committed Bytes, then click Add >>
10. Expand Logical Disk and select Free Megabytes, then click Add >>
11. Expand Physical Disk and select %Idle Time, then click Add >>
12. Expand Qlik Sense Scheduler Service and select every sub item available, then click Add >>
13. Expand  Qlik Sense Repository Service - Common and select every sub item available, then click Add >>
14. Expand  Qlik Sense Repository Service - REST API and select every sub item available, then click Add >>
15. Expand Qlik Sense Proxy service select every sub item available, then click Add >>
16. Click OK to close the dialog.
17. Change the Sample Interval to 5. Make sure that Units reads Seconds.
18. Click Next.
19. Choose a directory to save the logs in. Click Next.
20. Make sure that the new Data Collector Set is run with a Local Admin account. Select Save and Close and click Finish.
21. Select the newly created Data Collector Set in the tree view on the left pane.
22. Right-click DataCollector01 it in the right pane and select Properties.
23. Change Log Format to Comma Separated.
24. Open the File tab and enter a descriptive name for the log file, preferably using the local server hostname convention. In a multi-node environment, this is mandatory to determine which cluster node the logs are from. 
25. Click OK
26. Right-click the new Data Collector Set in the tree view on the left pane and select Start
27. Wait a few seconds and verify that the Data Collector Set are running.
28. Repeat for each cluster node.
29.  

Related Content:

• Qlik Sense Share Storage options and requirements  
• Hardware Settings For Best Performance With Qlik Sense 
• Qlik Sense: Persistence requirements 
• Antivirus exceptions for Qlik Sense McAfee, Symantec & Other Anti-Virus exclusions required 

[maksim_senin]

Hello @Bastien_Laugiero ,

Thank you for that helped to save some time on configuring!

Just one suggestion - does not it make sense to add page file metrics to the counter?

Thank you.

Best regards,
Maksim

[Sonja_Bauernfeind]

Hello @maksim_senin 

Not all troubleshooting scenarios are covered in this article, as different issues or monitoring requirements will require different counters, such as when you need to troubleshoot network or disk-related issues. 

Adding page file metrics is certainly a good choice if you're looking for additional data.

All the best,
Sonja