topic qvd size in QlikView

qvd size

prabhas277 — Tue, 16 Jun 2015 04:38:21 GMT

Hi experts,

My Database size having 1gb data now that data is converted into qvd then what is the size of qvd?

Re: qvd size

prashantbaste — Tue, 16 Jun 2015 05:02:12 GMT

Hi Prabhas,

Qlikview has very good compression ratio- almost upto 90% (in ideal conditions).

If your data is 1GB - your qvd can be 100MB (But you can expect upto 70-80% on an average; even if your qvd size is upto/between 200-300 MB its okay).

Hope this is helpful for you.

Regards,

Prashant P Baste

Re: qvd size

prabhas277 — Tue, 16 Jun 2015 05:03:52 GMT

Thanks For Sharp reply..

Re: qvd size

Tue, 16 Jun 2015 05:32:59 GMT

Hi Prabhas,

When you extract any data source file it stores as qvd. The qlikview stores data In QVD In encrypted form. So data are compressed In QVD.

If a data source file is of 10 MB size. When its convert into QVD then size reduces up to 90%. So in QVD size of data is near about 1 MB.

Ramya.

Re: qvd size

prabhas277 — Tue, 16 Jun 2015 05:49:17 GMT

Thanks Ramya..

Re: qvd size

Tue, 16 Jun 2015 06:31:55 GMT

If it is optimized qvd it will compress up to 90% if the data is 1GB it will reduce to 100MB to 200MB

If it is unoptimized qvd it will compress up to 10%- 90%.

hope it will helps you

Thankyou

Re: qvd size

rajeshvaswani77 — Tue, 16 Jun 2015 06:38:04 GMT

Hi Prabha,

You need to store only required fields in the QVD, others you can leave them out.

Also the QVD is smartly stored, if the column has only two distinct values, then that value will be stored only twice and remaining will be just pointers to that value.

thanks,

Rajesh Vaswani

Re: qvd size

Miguel_Angel_Baeyens — Tue, 16 Jun 2015 09:38:58 GMT

Prabhas,

It is almost impossible to say without doing further analysis on the types and values of your data in that database.

But I would suggest you to take a look at these two posts to get you an idea on how QlikView uses and handles values and stores them:

Symbol Tables and Bit-Stuffed Pointers

The Importance Of Being Distinct

This said, QVD only stores one table, so if you are pulling more than one from the database, you are likely to use either JOINs or several QVD files.

Miguel

Re: qvd size

Miguel_Angel_Baeyens — Tue, 16 Jun 2015 09:39:47 GMT

Just for clarification, optimized QVDs are not how they are stored, but how they are loaded.

It has nothing to do on how much data you store, but instead how do you LOAD it when you refer to the QVD in the QlikView script.

Miguel

Re: qvd size

sgrice — Tue, 16 Jun 2015 09:51:08 GMT

Just do your biggest table.

Connect TOMYODBCDB;

myTestTable:

Select * from myBIGTABLE;

Store myTestTable into myTestTable.qvd(qvd);

You will be amazed how small it is. But just like any other reporting tool avoid FREE text fields.