Skip to main content

Qlik

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
jixiaoquan
Contributor III
Contributor III
‎2015-01-21 10:14 PM

The rapid growth of memory after the amount of data up to 814 million line

Hi everyone,

    I have a  128 G memory computer.Recently I use this computer to load a qvd files,the qvd files have 1 billion 250 million line data.During the load process,it stopped when load 814 million ,before it stopped load the use of memory is 40 G ,when it stopped the use of memory grow to 100% in rapidly.

    About 10 minutes later,it go on to load the rest of data,but the use of memory keep in 100% until the end of load.

    Is it normal in this phenomenon?

    If it is abnormal,could you tell me why it appear this kind of imagination? And how to solve this problem?

245 Views
0 Likes
1 Reply
marcus_sommer
MVP
MVP
‎2015-01-22 06:52 AM

I assume it has what do with the way qlikview processed the data internal with Symbol Tables and Bit-Stuffed Pointers if the amount of data exceeds some point and needed to be extend. Have a look here:

http://community.qlik.com/blogs/qlikviewdesignblog/2012/11/20/symbol-tables-and-bit-stuffed-pointers

- Marcus

169 Views
0 Likes