topic Re: what is data limitation in qlikview? or qvd? or there is no limitation? in QlikView

what is data limitation in qlikview? or qvd? or there is no limitation?

Tue, 08 Jul 2014 15:53:13 GMT

what is data limitation in qlikview? or qvd? or there is no limitation?

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

Tue, 08 Jul 2014 17:14:54 GMT

Hi,

I think there is no data limitation in qlikview. If u can provide enough infrastructure or enough memory then, u can load

data how much u want.

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

hic — Tue, 08 Jul 2014 19:34:30 GMT

There is one hard limit: 2 billion distinct values in a field. Apart from that, it is only a matter of fitting the data into RAM and having the patience to wait for the answer (CPU time).

HIC

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

Mon, 22 Sep 2014 20:20:52 GMT

With unlimited number of fields ? and is it the same for Sense ?

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

MichaelTerenzi — Mon, 22 Sep 2014 20:29:43 GMT

-Mikael-

Good question, perhaps Henric Cronström or Michael Tarallo may know if the same limit applies in Qlik Sense.

Cheers,

- Michael

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

hic — Mon, 22 Sep 2014 20:59:09 GMT

I am fairly sure that it is the same as in QlikView. The engine is still the same.

HIC

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

Tue, 23 Sep 2014 07:52:55 GMT

Ok thx.

Can you common on the distinct part? Is a "distinct value" just a set of field/row or that whether there are similar values should make a difference?

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

hic — Tue, 23 Sep 2014 08:12:35 GMT

"Distinct" means distinct field values. Whether they are similar or not, doesn't matter. Read more on Symbol Tables and Bit-Stuffed Pointers. The limit is that the symbol tables are limited to 2 billion rows.

HIC

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

humansoft — Wed, 19 Aug 2015 07:51:57 GMT

hic, is it true what you wrote?

My Customer have app with more than 2147483648 records in one table. There are no field/s with 2 billions of distinct values.

Take a look at the following screenshot from "Document Properties" -> "Tables":

Look at number of rows -> "-1863984112" rows in main fact table. This table has more than 2147483648 records.

QV: 11.20.12852.0 SR11 x64

hic, more info: QT Support Case 00502034.

What do You think about it?

Best regards

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

hic — Wed, 19 Aug 2015 10:15:35 GMT

My guess is that there is a problem in how numbers above 2B are displayed. The first bit in a 32-bit integer stores the sign; plus or minus. The remaining 31 bits are used for the number.

So, if a number exceeds 2 147 483 648 it will be incorrectly displayed as a negative number, and this is also what you see in this case. My guess is that the table has 2 430 983 184 records (Pow(2,32)-1 863 984 112).

What do you get if you use Count(Field) in a text box?

HIC

Re: what is data limitation in qlikview? or qvd? or there is no limitation?

humansoft — Wed, 19 Aug 2015 11:16:24 GMT

hic‌, text box with count(Field) returns 2 430 983 184:

EDIT: MemStats returns exact 2 430 983 184 records, like You wrote.

The problem is because the application with more than 2147483648 records in one table is very, very slow - from 5 to more than 20 times. For example: only expand the listbox takes more than one minute, where in app with less than 2147483648 records takes less than a second.