Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I have read about QlikView that we can’t fit very much data in memory.
What you say on this?
All QlikView data is held in memory, one the data is loaded, there is no disc access.
If your data model is efficient then you can load a large amount of data in memory, if you have an inefficient data model then you will not be able to load as many records.
For example storing timestamp values to the millisecond requires more RAM than storing times to a minute or 10 minute interval.
The statement that "QlikView cannot load very much data in memory" is inaccurate, it depends on the data you are loading.
QlikView can fit all the necessary amount of data, given the necessary amount of RAM.
Of course, QlikView's In-Memory technology can't be used for big data, but there is a workaround to it: Direct Discovery: BI Review: First look at QlikView Direct Discovery
Quoting from Qlik's webpage:
QlikView’s patented in-memory data engine compresses typical data by a factor of 10, meaning a single 256GB RAM server can load upwards of 2TB of uncompressed data. This represents billions of rows while offering response rates only possible with in-memory architectures. Other QlikView features such as document chaining and binary load further accelerate the exploration of very large data sets. This is the path chosen by many Qlik customers to analyze terabytes of data stored in data warehouses or Hadoop clusters and similar repositories.
QlikView is In-Memory tool, so accordingly the size of ur data u SHOULD have corresponding RAM.
can’t fit very much data in memory---it's not right as per the above explanation.
From QlikView Reference Manual:
Limitations of the Amount of Data to be Loaded
"The amount of data that can be loaded into a QlikView document is very large. It is primarily limited by the amount of primary memory of the computer. However, there is one inherent limitation in QlikView that you must be aware of when building very large documents: A QlikView document cannot have more than 2,147,483,648 distinct values in one field. The number of fields and tables as well as the number of table cells and table rows that can be loaded, is limited only by RAM.
When running the 32-bit version of QlikView, RAM is limited to 2, 3 or 4 GB, depending on operating system version and configuration, regardless of the size of physical memory in the computer.This limitation does not exist when running the 64-bit version of QlikView."