topic Re: Out of memory in QlikView

Out of memory

Thu, 07 Mar 2013 07:26:54 GMT

I have a qvd of 8millions record which has only one column. Only i am checking is count(column), len(column) in Straight table. It works fine for 3million record but when it crosses 3 million - chart gave OUT OF MEMORY error. Is there any solution to get rid off with?

Thanks in advance.

Re: Out of memory

VishalWaghole — Thu, 07 Mar 2013 10:19:12 GMT

Hi,

Could you please tell me your machine RAM size.

Thanks

Vishal.

Re: Out of memory

Thu, 07 Mar 2013 10:59:37 GMT

4 GB RAM

Thanks

Re: Out of memory

VishalWaghole — Thu, 07 Mar 2013 11:07:03 GMT

Its might be your RAM issue...

Please check it with upgradable RAM.

Thanks,

Vishal

Re: Out of memory

Thu, 07 Mar 2013 11:16:15 GMT

How much RAM is requred/recomended for this much of records in QVD/DB? Is there any other harware required for these type of transaction?

Re: Out of memory

VishalWaghole — Thu, 07 Mar 2013 11:23:10 GMT

If you used huge size of data then you will required more size RAM.

RAM size is depend on your data size.

Re: Out of memory

Thu, 07 Mar 2013 11:27:10 GMT

Thanks a lot

Re: Out of memory

VishalWaghole — Thu, 07 Mar 2013 11:37:08 GMT

If this is valuable information then mark it is as Currect Answer other wise as helpful answer.

Thanks,

Vishal

Re: Out of memory

sushil353 — Fri, 15 Mar 2013 07:56:18 GMT

check your document size..

Is it exceeding 4 gb size...

Re: Out of memory

Fri, 15 Mar 2013 10:00:58 GMT

qvd size is 1.30 GB And yes it utilizes full ram i.e; 4gb. I tried it on 16gb RAM, there at it utilizes 15gb.

Re: Out of memory

Fri, 15 Mar 2013 10:04:06 GMT

Hai,

This case at lease u would have 16 gb ram and 8 cpu core

Re: Out of memory

Fri, 15 Mar 2013 10:48:50 GMT

Yes, already tried on 8 cpu core & 16gb ram where there it consumes 15gb of RAM.

Re: Out of memory

kaushiknsolanki — Fri, 15 Mar 2013 11:04:18 GMT

Hi Navneet,

I would suggest you to do following things for getting the count and sure your performance will be much much better.

assume following is your code.

load Field From XYZ;

you are using the count(Field) in your chart. But try below to overcome the problem.

Load Field,'1' as Flag From XYZ;

now use the below expression.

sum(Flag) to get the count.

Hope the idea is clear.

The Count function is resource intensive, where as Sum is not. So whenever you need count of field, use the above logic to improve the performance and reduce the load on chart as well as application.

Regards,

Kaushik Solanki

Re: Out of memory

Fri, 15 Mar 2013 12:21:30 GMT

Perfect Kaushik. Thanks for sharing this concept.