topic MEM file analysis in QlikView

MEM file analysis

Wed, 19 May 2010 13:03:30 GMT

Hi!

There have been a few discussions about MEM files, but I cannot find my answers in those posts...

I would like to know whether you have any experience with MEM file analysis? Have you used them in production environment to improve performance?

I would also like to know what exactly do partucular types and especially subtypes mean (selection, state, etc)? What exactly is the meaning of COUNT attribute? At first I thought the names are pretty straightforward, but looking at the values I'm left perplexed... Is there any documentation available?

The other thing that puzzles me is the fact that I have created a MEM file from a file that hase hundreds of sheet objects, but there are data for only 5 text objects in the file? Is there a tright or wrong way to create a mem file with full data? I used "Document properties > General > Memory Statistics" on a file in AccessPoint folder.

Thanks for your replies.
Bostjan

MEM file analysis

mr_barriesmith — Tue, 19 Jul 2011 12:52:13 GMT

I agree. A definition would be useful. In my experience, you have to open the document and move through each sheet so that each object can calculate... any sheet object not opened does not calculate and therefore will have no stats because it isn't using cpu or RAM.

From what I have seen, RAM usage is in three parts:
Database - Tables/fields
State - the user selections
Sheet objects

I think this information could form an invaluable tool for a structured development team.

Re: MEM file analysis

matt_crowther — Tue, 19 Jul 2011 14:54:18 GMT

Attached may be of use (not a definition unfortunatley), it's a Sea Trial application for .qvw's to be deployed to Production, it analyzes a .qvw for field usage and individual field and object memory usage.

It's based on an app created by Rob Wunderlich with the added inclusion of the mem stats data to enhance the functionality.

All our dashboards pass through this process before they hit the production enviroment; it's suprising how many .qvw files have un-used fields loaded in that just sit there doing nothing or how one chart can take up most of the memory usage.

Hope it helps,

Matt - Visual Analytics Ltd

Re: MEM file analysis

mr_barriesmith — Tue, 19 Jul 2011 15:29:51 GMT

Very useful - thank you.
I've been testing the QlikView 10SR2+ metadata where if you read a .QVW as XML you get some metadata exposed; very good start but just missing some important bits.

In my testing I share your finding of surprise at the impact of various objects on RAM/cpu. Your model looks at Database and State Space; I also found Sheetobject in MEM stats to be good to review... ah it was there in your Objects sheet!

Appreciate your sharing... off to do more analysis.

Re: MEM file analysis

Anonymous — Tue, 26 Jul 2011 08:44:20 GMT

Hi !

This seems to be very interesting. So I try to optimize my .qvw with "Sea Trials Application.qvw" but when I click on the "Process Doc" button, the macro window appear and seems stop at line 439 :

"Set openOutputFile = objFSO.OpenTextFile (filename, ForWriting, True) "

Could you please explain me where the error comes from ? Or how to use this qlikview optimizer application ?

Thanks in advance for your help !

Alex.

MEM file analysis

matt_crowther — Thu, 01 Dec 2011 15:11:52 GMT

I've just noticed this issue my self and the error appears to be a result of the fact that the latest versions (V10 SR3) have fixed the Memory Stats export bug whereby it was given a .txt extension.

To fix simply change the .txt file extensions in teh script to '.mem' extensions and the load should work fine.

Alt' Best,

Matt - Visual Analytics Ltd

Re: MEM file analysis

rwunderlich — Fri, 16 Dec 2011 16:31:00 GMT

Matt,

I know your sea trials app is based on my DocumentAnalyzer. You may want to download the latest version

http://robwunderlich.com/downloads/

which generates the .mem file automatically.

-Rob

Re: MEM file analysis

Wed, 25 Feb 2015 06:58:02 GMT

it is not working.

when i click check, the following screen appears.

pls help.

Re: MEM file analysis

agni_gold — Tue, 04 Aug 2015 12:03:59 GMT

hey,,

Did you get the solution??