Qlik Community

Ask a Question

QlikView App Dev

Discussion Board for collaboration related to QlikView App Development.

Announcements
Join this live chat April 6, 10AM EST - QlikView to Qlik Sense REGISTER
cancel
Showing results for 
Search instead for 
Did you mean: 
alemate556
Partner
Partner

How much weight can hold one qvd file?

I have an incremental qvd file and weights like 2gb, but when I call certain data from 2 past weeks, doesn't work normally.

5 Replies
neetha_p
Master
Master

Hi

Please Can you explain issue in more detail.

Regards

Neetha

JonnyPoole
Employee
Employee

The size ?  I don't believe we have limits on size (except disk space). 

When you are dealing with large QVDs you can instead and should consider  loading and storing them in segments.

So if you pull 3 years of data into one QVD like this

Table:

Load *

from <source>;

store ....   Table.QVD

Then consider using 3 different load statements to store 3 different QVDs.

A really great benefit to this is that you can execute the three loads and stores in DIFFERENT QVWs to accomplish a parallel load to support a tighter schedule. 

Your final app will of course re-concatenate the 3 QVDs back into one table, but that action is very fast with qlikview.

Table1:

Load *

from <source>

where year =2014;

store ....   Table1.QVD

Table2:

Load *

from <source>

where year =2013;

store ....   Table2.QVD

Table3:

Load *

from <source>

where year =2012;

store ....   Table3.QVD

Clever_Anjos
Employee
Employee

Bigger QVD´s can lead to serious problem of I/O creating some bottlenecks.

Suppose you have an incremental load that read 2Gb, concatenate more 2Mb and stores again 2Gb.

4Gb are pushed into I/O controler and disks (or network)

As a "rule" I try to not have more 100Mb each QVD.

Not applicable

hiiii.... can you please send me sample project of qlik?

Not applicable

not in giga bytes... its in MB's