topic how to load 2gb data daily in QlikView

how to load 2gb data daily

SunilChauhan — Wed, 08 Feb 2012 12:26:59 GMT

hello all i have csv of 2gb .

how to load 2gb data on daily basis.

how to load 2gb data daily

rbecher — Wed, 08 Feb 2012 12:28:37 GMT

What's the problem with it? Can you describe your issue..

how to load 2gb data daily

SunilChauhan — Wed, 08 Feb 2012 12:30:05 GMT

i have one csv file of 2gb i want to convert into qvd.

but i extract into qlikview . system hangs.

what can i do?

Re: how to load 2gb data daily

rbecher — Wed, 08 Feb 2012 12:39:13 GMT

The file size shouldn't be a problem...

Which OS version? Which QV version?

Are you short on memory?

Are more than one table involved (synthetic keys etc.)?

How is the format of the CSV (delimiter, quoting etc.)?

How many records?

how to load 2gb data daily

boryspower — Wed, 08 Feb 2012 12:43:51 GMT

Is it anything You could load incrementally? Like transactions etc?

how to load 2gb data daily

SunilChauhan — Wed, 08 Feb 2012 12:50:47 GMT

os is window microsoft windows xp version 5.1.2600

we have both qlikview 9 and 10.

i have 2gb of Ram

Only one table

csv is in delimiter format

records:approx 9000000per month ( 300000 lacs per day)

Re: how to load 2gb data daily

rbecher — Wed, 08 Feb 2012 12:58:08 GMT

Is the qvw file empty before loading the CSV file? Why you want to store/convert data into a QVD file?

Can you post your script?

how to load 2gb data daily

SunilChauhan — Wed, 08 Feb 2012 13:05:24 GMT

Thanks for reply

yes qlikview file is empty.

i want to compress data using qvd.

or if if you have some other way then please explain.

actually i am not able to fetch Csv file into qlikview

after selecting Csv file system hangs.

how to load 2gb data daily

Wed, 08 Feb 2012 13:09:18 GMT

in 32bit enviroment the virtual address space of processes and applications is limited to 2 GB.

In this case, sometimes I used the /3GB switch.

view :

http://dwf.blogs.com/beyond_the_paper/2009/04/enabling-3gb-switch-on-windows-vista.html

http://msdn.microsoft.com/en-us/windows/hardware/gg487508.aspx

how to load 2gb data daily

SunilChauhan — Wed, 08 Feb 2012 13:22:12 GMT

Thanks for Reply

How to achieve /3GB switch?

is it already available.

how to load 2gb data daily

Wed, 08 Feb 2012 13:29:04 GMT

follow instruction as reported in the first link

Right-click My Computer. Click Properties.
In the System Properties dialog box, click the Advanced tab.
On the Advanced tab, under Startup and Recovery, click Settings.
In the Startup and Recovery dialog box, under System startup, click Edit. The Windows boot.ini file will be opened in Microsoft Notepad.
Create a backup copy of the boot.ini file. Note: Boot.ini files may vary from computer to computer.
Select the following line in the boot.ini file:

multi(0)disk(0)rdisk(0)partition(2)\WINDOWS="Microsoft Windows XP Professional" /fastdetect

Press Ctrl+C to copy the line and then press Ctrl+V to paste it immediately below the original line.
Note: Your text string may be different from the text string in this solution, so be sure to copy the text string from your boot.ini file, and not the text string included here.
Modify the copied line to include “ /3GB”, as shown in the following example:

multi(0)disk(0)rdisk(0)partition(2)\WINDOWS="Microsoft Windows XP Professional 3GB" /3GB /fastdetect
Note: Do not overwrite any existing lines.

Save and close the boot.ini file.
Click OK to close each dialog box.
Restart your computer.
During startup, select the 3GB option. If you do not select the 3GB option, the system will default to the 2GB total memory setting.

Re: how to load 2gb data daily

rbecher — Wed, 08 Feb 2012 13:29:44 GMT

However, if the wizzard is hanging you probably could code the load statement by hand..

how to load 2gb data daily

SunilChauhan — Thu, 09 Feb 2012 08:37:41 GMT

@Alex:

what do you mean by below lines.

During startup, select the 3GB option. If you do not select the 3GB option, the system will default to the 2GB total memory setting.

@Ralf : Its taking two much time

and i have to load 300000 recards daily .

how to load 2gb data daily

rbecher — Thu, 09 Feb 2012 08:44:57 GMT

Don't know what yo mean with "too much time". I meant coding the load statement without using the wizzard. You could also try to code the load statement with a sample file with a few records only.

how to load 2gb data daily

Thu, 09 Feb 2012 08:49:38 GMT

during boot you view 2 options:

Microsoft Windows XP Professional

Microsoft Windows XP Professional 3GB

choose the second one.