topic Re: Reload Qlikview and RAM usage in QlikView

Reload Qlikview and RAM usage

sarafamiglietti — Wed, 23 Nov 2016 10:25:33 GMT

Hello,

I need to understand how Qlikview is working when loading data.

I have a document which loads 63 million of rows

The final size of this document is around 6Go, but during the reload, the RAM used is 40Go.

Why RAM usage is increasing during the reload?

Thanks&Regards

Sara

Re: Reload Qlikview and RAM usage

MK_QSL — Wed, 23 Nov 2016 10:38:14 GMT

Qlikview Server RAM Calculator.xlsx

RAM Calculation QlikView App

Re: Reload Qlikview and RAM usage

jonas_rezende — Wed, 23 Nov 2016 16:10:10 GMT

Hi, Sara Famiglietti.

The memory allocated by application in-memory. See the document attached.

I hope this helps!

Re: Reload Qlikview and RAM usage

sarafamiglietti — Wed, 23 Nov 2016 16:23:33 GMT

Hello,

Thanks for all your answers.

But all documents explained how Qlikview Server manages RAM when Users use it.

In my case, I wan't to understand how Qlikview Server manages RAM during a reload.

Regards,

Sara

Re: Reload Qlikview and RAM usage

maxgro — Wed, 23 Nov 2016 17:15:27 GMT

I think it depends on your script, above all on the number of tables, fields (distinct values) and records

If you have one small table at the end but a lot of temporary table in the script the ram grows during the load but at the end you have a small .qvw (on disk).

You can add some trace in the script, open the log file during the load and look at the windows memory of the qv.exe to identify the script section where you have the highest RAM consumption

Re: Reload Qlikview and RAM usage

denniste — Thu, 08 Jun 2017 01:05:41 GMT

How do you do this ? Is there a Qlikview script you can use to write out the trace statement?

*look at the windows memory of the qv.exe

Re: Reload Qlikview and RAM usage

denniste — Mon, 31 Jul 2017 01:42:51 GMT

Use the code below within your script to write out the memory usage into a text file.

EXECUTE cmd.exe /c "Del memoryusage.txt /q"   ;
EXECUTE cmd.exe /c "@echo STEP 1 >> memoryusage.txt";
EXECUTE cmd.exe /c "tasklist /fi "imagename eq qvb.exe">> memoryusage.txt"   ;
//Qlikview script
EXECUTE cmd.exe /c "@echo STEP 2 >> memoryusage.txt";
EXECUTE cmd.exe /c "tasklist /fi "imagename eq qvb.exe">> memoryusage.txt"   ;

//Qlikview script

...

Re: Reload Qlikview and RAM usage

hectorgarcia — Fri, 06 Jul 2018 12:42:29 GMT

hi dennis couple of quiestions:

do you have to insert as many steps as desired measuring points in the script?
the command line with tasklist /fi "imagename eq qvb.exe" do i have to copy paste as is? or what do i have to put in "imagename eq qvb.exe" part

Thanks

Hector

Re: Reload Qlikview and RAM usage

denniste — Tue, 17 Jul 2018 03:13:11 GMT

Hi Hector.

1. Yes

2. Copy paste as is. We're pretty much running the same code but at different point during the reload process to determine the memory usage.