Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
SunilChauhan
Champion
Champion

how to load 2gb data without increasing the configuration

hello all,

I have 2gb of data file which is in csv.i have 2GB RAM.

I am not able to load file. is there any way we can compress data  without increasing the system configuration.

Regards

Sunil Chauhan

Sunil Chauhan
12 Replies
kaushiknsolanki
Partner Ambassador/MVP
Partner Ambassador/MVP

Hi,

     Why dont you create a QVD of that CSV file and then try to load in QlikView.

Regards,

Kaushik Solanki

Please remember to hit the 'Like' button and for helpful answers and resolutions, click on the 'Accept As Solution' button. Cheers!
mall1m
Partner - Contributor III
Partner - Contributor III

are you able to split data through several smaller QVD ?

for example, loading 1 year at a time, storing each year in a dedicated QVD

"FOR LOOP"

my_table

LOAD * FROM mycsv WHERE year=vYear

STORE mytable INTO mytable & vYear.QVD

DROP my_table

SunilChauhan
Champion
Champion
Author

Thanks

@mall1m:i dont want to break the  into qvd's

@Koushik: i aam not able to load csv then how can i able to create qvd.

Please ssuggest some other ways .

Sunil Chauhan
kaushiknsolanki
Partner Ambassador/MVP
Partner Ambassador/MVP

Hi,

     I think the way could be devide the data into QVD's. Say for example for one year or on another basis.

     And then again create a QVD whith combined data from all small QVD's and then try to load it.

Regards,

Kaushik Solanki

Please remember to hit the 'Like' button and for helpful answers and resolutions, click on the 'Accept As Solution' button. Cheers!
SunilChauhan
Champion
Champion
Author

@Koushik : i also thing to do this way.

but i want to load at once.

is it possible

Sunil Chauhan
kaushiknsolanki
Partner Ambassador/MVP
Partner Ambassador/MVP

Hi,

     Not possible the reason is while loading data QlikView loads data in RAM, and if you have less RAM then there is no chance.

     I dont know if it can be done by increasing the virtual memory.

     Just try that.

Regards,

Kaushik Solanki

Please remember to hit the 'Like' button and for helpful answers and resolutions, click on the 'Accept As Solution' button. Cheers!
SunilChauhan
Champion
Champion
Author

thanks kousshik,

how to increase virtual memory.

Sunil Chauhan
kaushiknsolanki
Partner Ambassador/MVP
Partner Ambassador/MVP

Hi,

     Go to Control Panel -> System -> Advanced System Settings -> Advanced tab -> Performance -> settings -> Advanced tab -> Virtual memory.

     This is for Windows 7.

Regards,

Kaushik Solanki

Please remember to hit the 'Like' button and for helpful answers and resolutions, click on the 'Accept As Solution' button. Cheers!
SunilChauhan
Champion
Champion
Author

but virtual memory also depends on Ram.

so do you thing will it be helpful

Sunil Chauhan