topic Re: Qvw size in QlikView

Qvw size

qlikview979 — Wed, 25 Nov 2020 16:16:04 GMT

Hi Experts,

If i load 100 GB data in qlikview,then is the Qvw Size?

Regards,

Mahesh

Re: Qvw size

ramasaisaksoft — Mon, 22 May 2017 10:09:58 GMT

Hi Mahesh,

we already know that approximately Qlikview will compress the data 90%,but it is depend on the data.

Ex:-

eid ,esal

1 ,100

2 ,100

3 ,300

35 ,100

here QV will save data into qvd as

100 ,300

1,2,3,35

eid

esal

so QV maintain the data Distinct ,Not Null values so it will compress data 90% but if ur data won't repeated it won't compress.

Conclusion:- Definitely QV reduce your data but not sure how much in the form of size

Re: Qvw size

qlikview979 — Mon, 22 May 2017 10:16:39 GMT

Hi Ram sai,

Yes I agree with you,

I have 100 GB Unique data. when i load into qlikview here i am expecting Qvw Size.

Re: Qvw size

Peter_Cammaert — Mon, 22 May 2017 10:25:48 GMT

There is either a verb or a pronoun missing at the end of your sentence. Did you mean to say "...then what is the Qvw size?"

That depends on how much QlikView can compress your data, and what selection you made in Settings->Document Properties->General->Save Format. so there is no straightforward answer to your question.

In ideal conditions and low cardinality, QlikView can compress data at least an order of magnitude. Best thing is to perform a few tests with relevant subsets.

Re: Qvw size

ramasaisaksoft — Mon, 22 May 2017 10:38:39 GMT

Hi Mahesh,

it is impossible to get a direct answer/single answer for your question.

why because if you want to load 100 Gb data into QV means you need to have more than that GB RAM size(i mean more than 100 GB RAM).

and you already know any of our In-memory tools(QV,Table au,Spotfire..etc) won't work large amount data and also Random data.

u can't say/judge for 10 MB data 5 MB qvw file will create.

if your doubt is not clear feel free to reach me on 8376 964 364 .

Re: Qvw size

Colin-Albert — Mon, 22 May 2017 10:39:05 GMT

It depends on the type of data and the variability of the data - i.e the number of unique values.

Have a look at this post The Importance Of Being Distinct

Re: Qvw size

qlikview979 — Mon, 22 May 2017 10:46:06 GMT

Hey sai,

Thanks

Re: Qvw size

qlikview979 — Mon, 22 May 2017 10:49:22 GMT

Thanks for Every one,

Re: Qvw size

Anonymous — Tue, 23 May 2017 09:26:00 GMT

Hi,

You should expect roughly 1TB of the qvw size.

Re: Qvw size

qlikview979 — Tue, 23 May 2017 09:29:33 GMT

Thanks for kindly information.

Re: Qvw size

Peter_Cammaert — Tue, 23 May 2017 09:38:32 GMT

From 100GB in source data to ... 1TB in file size? That would mean that every single value is stored 40 times over in the QVW (assuming that extremely large documents on average compress the source data volume to about 25% of the original size)

Can you explain where and why this happens?

Re: Qvw size

qlikview979 — Tue, 23 May 2017 09:42:58 GMT

Hi Peter,

Not happen,One day some one asked me this.

Thanks for clarification.

Regards

Re: Qvw size

Peter_Cammaert — Tue, 23 May 2017 09:46:36 GMT

I'm still curious as to why thabang_petje stated this.

Re: Qvw size

Anonymous — Tue, 23 May 2017 09:50:26 GMT

I was assuming if loading from a QVD actually. I see now it is from source