Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
surajap123
Creator III
Creator III

performance issue

Hi All,

Our qv server configuration-

2 physical 8 core Intel Xeon e5-2690 @ 2.90Ghz

and 380 Gb RAM


The total size of all qlikview applications that the qlikview server is 70GB.

so even if all the qlikview applications are accessed by users(ie 70*3= 210 GB utilized) the server still have 170GB(380-210=170) memory free.

The biggests dashboard has approx 100 million rows.

From the qv access point, Whenever i click on any tab it takes approx 10 seconds to open and similarly all the charts in the that tab start taking approx 10 secods to fully load.

we have enabled preload in the qv server.

The expressions in the charts are not very complex..

I am not sure where to start troubleshooting this issue?


Regards,

Suraj

1 Solution

Accepted Solutions
shane_spencer
Specialist
Specialist

How often do you reload documents? If you do not have a Publisher you need to take in to account the impact of reloads on your system.

1GB is not massive. We have documents of 8GB.

"Approx..All the doucments are used by end users regularly." How regularly? At least once an hour, day, week?

"So you mean, i should increase the RAM 85-90% of existing 380gb."

I mean you can tweak the working set low as per below. I think the default is 70%. This is the amount of the Servers RAM that QVS Process can use. If you set this to 70% then 114GB would be left for whatever else on the server requires RAM. You need to analyse what you memory requirements are for other processes but for example setting Working Set Low to 90% would still leave 38GB for everything else on the server.

This would mean you are making better use of your servers memory but it will not necessarily fix your issue. Please do not focus too heavily on memory / hardware, this is an easy trap to fall in to.

working set min.JPG.jpg

I would not recomend adding more RAM. This is unlikely to improve user performance! This sounds more like an issue with the document design. Again what does your dashboard look like? Are there many charts and objects visible on 1 sheet?

Check the basics though first. Go to task manager and see what CPU and Memory utilistation are like. Restart QVS and measure how long it takes for the size of the QVS process to get up to Work Set Low level. If you want to do this properly set up Perfmon to collect the following metrics:

\LogicalDisk(D:)\Avg. Disk Bytes/Transfer

\LogicalDisk(D:)\Avg. Disk sec/Read

\LogicalDisk(D:)\Avg. Disk sec/Write

\LogicalDisk(D:)\Current Disk Queue Length

\LogicalDisk(D:)\% Free Space

\LogicalDisk(D:)\Free Megabytes

\Memory\% Committed Bytes In Use

\Memory\Available MBytes

\Memory\Page Faults/sec

\Memory\Pages/sec

\Memory\Pool Nonpaged Bytes

\Memory\Page Reads/sec

\Network Interface(*)\Bytes Total/sec

\Network Interface(*)\Current Bandwidth

\Paging File(_Total)\% Usage

\PhysicalDisk(_Total)\% Disk Time

\PhysicalDisk(_Total)\Avg. Disk Bytes/Transfer

\PhysicalDisk(_Total)\Avg. Disk Queue Length

\Process(QVDistributionService)\% Processor Time

\Process(QVDistributionService)\Private Bytes

\Process(QVDistributionService)\Thread Count

\Process(QVDistributionService)\Virtual Bytes

\Process(QVDistributionService)\Working Set

\Process(QVDirectoryServiceConnector)\% Processor Time

\Process(QVManagementService)\% Processor Time

\Process(qvs)\% Processor Time

\Process(QVDirectoryServiceConnector)\Private Bytes

\Process(QVManagementService)\Private Bytes

\Process(qvs)\Private Bytes

\Process(QVDirectoryServiceConnector)\Thread Count

\Process(QVManagementService)\Thread Count

\Process(qvs)\Thread Count

\Process(QVDirectoryServiceConnector)\Virtual Bytes

\Process(QVManagementService)\Virtual Bytes

\Process(qvs)\Virtual Bytes

\Process(QVDirectoryServiceConnector)\Working Set

\Process(QVManagementService)\Working Set

\Process(qvs)\Working Set

\Processor(_Total)\% Interrupt Time

\Processor(_Total)\% Processor Time

\Processor(_Total)\Interrupts/sec

\QlikView Distribution Service\*

\QlikView Management Service\*

\System\Context Switches/sec

\System\Processor Queue Length

\Web Service(_Total)\Bytes Total/sec

\Web Service(_Total)\Current Connections

\Web Service(_Total)\Total Method Requests/sec

\Web Service Cache\File Cache Hits %

\Web Service Cache\Kernel: URI Cache Flushes

\Web Service Cache\Kernel: URI Cache Hits %

\Web Service Cache\Kernel: URI Cache Misses

      

Are the slow responses all the time? Or only at times of High Memory or High CPU utilisation? Expect spikes in CPU but not running constantly high. QlikView is an "In Memory" application so no matter how much memory you give it, it will use it eventually. You need enough for you Documents base footprint and a bit more for cached results. If memory running out / high causes an issue you can manage this with QVS Restarts or Cache Flush, but I don't believe this is the cause of your issue.

Your issue sounds more like poor document design. Are all Documents slow? Or just certain ones? Can you create a new tab of a large document with 1 simple chart and see if that tab is slow to load? You need to narrow down the cause of your issue by process of elimination.

View solution in original post

15 Replies
Not applicable

You may have already checked it. But you can right click on the sheet then properties>>Objects. It gives you time and memory consumption  of each report on the sheet. Just a thought.

Thanks

surajap123
Creator III
Creator III
Author

Thanks for the input..

Just out of curiosity, i want to know, does the remaining memory ie 170 GB(as per my example above), is also used by the qlikview dashboards, when concurrent users accedd the dashboard?

Which memory is used while accessing the qlikview document in access point(I mean, is it qv server memory or user computer memory)?

Does, increasing the RAM will resolve the performance issue?

tresesco
MVP
MVP

Suraj Kumar wrote:

.....

Which memory is used while accessing the qlikview document in access point(I mean, is it qv server memory or user computer memory)?

Does, increasing the RAM will resolve the performance issue?

What do you mean by 'qv server memory' ? Yes increasing RAM should help. For better understanding see: Re: Calculate how much RAM needed?

surajap123
Creator III
Creator III
Author

HI  tresesco,

i have gone through the thread you provided.

i Tried using the sizing excel file, with the example  in that thread-

source file size- 50 gb

TOtal users- 200

THe excel fives the output  120 gb total RAM needeed.

but you have answered 900 gb.

am i entering wrong values in the sizing file.?

tresesco
MVP
MVP

Total User <> Concurrent User. Concurrent user - 200 implies approximately 2000 Total users.

surajap123
Creator III
Creator III
Author

Thanks !!

Could you please tell me how you got 900gb for the

source file size- 50 gb

Total users- 200

as i have very little understanding of the excel sheet you provided

tresesco
MVP
MVP

To get 200 concurrent users, put 2000 in the total users input cell.

surajap123
Creator III
Creator III
Author

i got it now..

so i have to enter

source file size- 50 gb

Total users- 2000.

so, i have to add a zero for actual users to get the right RAM Requirement..

surajap123
Creator III
Creator III
Author

Thanks you so much!!

only a final query..

I am wondering how to find the 'Source File Size'. My final qvw get the data from QVD. So shall i have to take the size of all the qvd's used for the Final qvw?