topic Re: QVD file Performance in QlikView

QVD file Performance

Mon, 26 Jan 2026 18:19:17 GMT

Hello Team

Good evening, i would like to know how to test the performance of QVD file while loading data at the dash board.

Say for example

If I am having 100 million records - how many hrs it takes

If i am having 1 GB of data how many hrs it take

if i am having 10 GB of data how many hrs it take.

Is there any object which help us to find or we need to do any thing manually(kindly share if there any statement for it)

Thanks

Srini

Re: QVD file Performance

rbecher — Thu, 22 Aug 2013 10:04:47 GMT

Hi Srini,

this is also dependend from the data itself (cardinality). Why not create relevant test data in different size (1 GB, 10 GB etc.) and measure the loading time?

- Ralf

Re: QVD file Performance

Thu, 22 Aug 2013 10:08:22 GMT

I understood Ralf, but at the development it is not possible for us. when the dashboard moved to Production only we face this issue and more over we need to provide the information to client about the statical information, I am just quizing like oracle /Sqlserve we are planner tool is available. just like that is there any way to find.

Re: QVD file Performance

sujeetsingh — Thu, 22 Aug 2013 10:15:53 GMT

I too facing an issue that i am having a qvw of memory 37 mb but at a straight table it comes out of memory .

Re: QVD file Performance

rajeshvaswani77 — Thu, 22 Aug 2013 10:18:41 GMT

Hi Srini,

You might have to look at the option of incremental load if it suits your context.

thanks,

Rajesh Vaswani

Re: QVD file Performance

Gysbert_Wassenaar — Thu, 22 Aug 2013 10:25:29 GMT

Simply test. First load 100.000 records and measure the time:

LET vStart = num(now());

FIRST 100000

LOAD * from somewhere;

LET vRunTime = interval(now() - $(vStart),'mm:ss');

Then look at the content of the vRunTime variable to see how long it took. Next you can try a million rows or just extrapolate.

Re: QVD file Performance

Thu, 22 Aug 2013 10:27:44 GMT

But how you will collect the time

say for eg..

20 data 5 Sec

30 data 7 Sec etc

Re: QVD file Performance

Thu, 22 Aug 2013 10:29:31 GMT

Sure GW

will check it out and come back to you

Re: QVD file Performance

Thu, 22 Aug 2013 12:08:24 GMT

yes even i too faced the same same out of memory at the straight table but when i reload the qvw it is working fine. dont know why

Re: QVD file Performance

StefanBackstrand — Sat, 14 Sep 2013 20:15:42 GMT

As G Wassenaar says; the only way is to measure the time to reload on a subset of the actual data on the same hardware and then draw conclusions by extrapolating.

Also make sure to frequently cross-match the script logs from the reloads, they will have timestamps on literally each script row executed. A skilled QlikView developer could easily make a qvw that consumes the script log and measure duration between each log row timestmap. That can then be compared to see trends, and even do forecasts.

Re: QVD file Performance

Mon, 07 Oct 2013 16:10:56 GMT

Do you know what is the limiting factor for the load, CPU or disk Bandwidth (or IOPS)? You might make a wild guess just extrapolating from what you have from a smaller dataset. In my case it would probably be the disk bandwidth as I have plenty of CPU cores.

Re: QVD file Performance

Clever_Anjos — Mon, 07 Oct 2013 16:15:39 GMT

It´s hard to infere without knowing your data and your server.

I have some app´s for example that load´s 50 mi of rows (9 gb of data) in only 5 min.

Remember to try to acchieve Optimized Load for all your QVD´s (not applying functions or transformations while loading)