QV Can load and handle Billion of records ?

[#1]

Hi all,

I want to extractmore than 600million record in mysql data base to qlikView (only one month data).  I used my sql odbc connector. In loadingi used

“ limit” function  to reduce  the number of  records. At a one time I can load 10million records(with 10 columns) within 20minit , without effect to server. If I increase thelimits of records the server will stack .

My questions are,

1. Is there any methods to do this ?
2. After loading , Qlik view can handle this kindof data volume?

1 months  = 600million

1 yead        = 600 * 12

                     = 7200 million.

Plz give me a solution to success this? 

thanx,

Savi.

[#2]

In itself, QV is capable of handling more than a billion of records, but due to a timeout it might not be possible to load it all at once.

Since loading 10 million rows is no problem you might want to do it in these portions multiple times. Each time storing it in a QVD. This QVD might also save you loading all the historical data again the next time.

[deepakk]

Hi Savi,

Wats your system configuration ? Since Qlikview loads the data into the  Memory, you might require a better machine(RAM) to load all the data.

Once the data is loaded from your SQL database then make sure you store it in QVD format.

Deepak

[#4]

     thanx Deepak and Kjeld.

My server is HP G5, memory is 16GB. is it ok for this job.

thanx,

Savi.

[#5]

hi Deepak,

what is the recommend server for this .

thanks

Savi

[deepakk]

hi Savi,

Its very low of this kind of data. you require atleast 100GB of RAM or even more.!!

Deepak