topic QVD compression logic in QlikView

QVD compression logic

Fri, 15 May 2009 02:07:06 GMT

Hi All,
I have created QVD file and also i have created qlikview file extracted data from database directly. But i saw the huge difference in size of the Qlik view file and QVD file. In the manual they had mentioned 90% compression will happen in QVD file. I would like to know how QVD compress this much. What compression logic they have used?

Where can i find those stuffs?

Thanks,
Raghu.

QVD compression logic

Fri, 15 May 2009 02:37:21 GMT

Hi Raghu,

QVD files are not compressed, in fact they are text files with an XML header followed by bit-stuffed separated data records, column by column. The QlikView application with extension QVW is the one that is compressed.

Regards,

Mark

QVD compression logic

Fri, 15 May 2009 14:11:52 GMT

Mark,

As you said "QVW is the one that is compressed", so QVD will consume more memory. I mean size of the QVD is more than QVW file. What is the use of creating QVD?

-Raghu

QVD compression logic

Fri, 15 May 2009 14:26:42 GMT

Raghu,

The use of creating QVD files has as main purpose to store data from a data source in a format that is faster to load. This can be used for example in incredemental reloads where a user doesn't want to load all data from its data source but only the new data. The other (old) data can be loaded from the QVD. This results in faster reloads, but can only be used if the data source has many records that are not changing any more. Hope this helps you.

regards Mark

QVD compression logic

Fri, 15 May 2009 14:54:07 GMT

Thanks Mark,

So create a QVW document from QVD file we need 3 documents

1) We need a QVW doc to create a QVD file. So 2 files

2) create qlikview file using QVD file.

Am i right.

Regards,

-Raghu

QVD compression logic

Fri, 15 May 2009 15:11:33 GMT

Yes, generally you split the process into two parts, first is getting the data from conventional sources and storing it in QVDs, and second step is creating the main application which loads from these QVD files.

QVD compression logic

Fri, 15 May 2009 17:04:55 GMT

Thanks for all your answers

Thanks,

Raghu.