topic Re: Is there any relation between OLEDB reload and RAM size? in QlikView

Is there any relation between OLEDB reload and RAM size?

bluecarbon — Wed, 07 Oct 2015 14:47:33 GMT

Hi All,

When I try to reload data from two different machines to same data source through oledb, the reload time varies a lot.

Below is time difference and I feel it because of the RAM size. Can anyone let me know if it is because of the RAM size the time is getting shorten or is there any other possiblitiy?

30min -> 16GB RAM

5 mins -> 128GB RAM

Thanks,

Rakul.

Re: Is there any relation between OLEDB reload and RAM size?

pokassov — Wed, 07 Oct 2015 15:38:32 GMT

Hi!

Do you mean RAM on DB machines?

I think the answer depends on DBMS type.

DBMS has to fetch data to give it to qv.

Enough RAM allow DBMS keep most used data in memory and don't get data from hard drive.

Re: Is there any relation between OLEDB reload and RAM size?

Anonymous — Wed, 07 Oct 2015 15:58:06 GMT

The data being loaded from your database will populate a QV table in RAM.

If that QV table in RAM exceeds 16GB then on your 16GB RAM machine it will start swapping to the page file and swapping don't half slow QlikView down. But your 128GB RAM may well be handling it without swapping.

On the 128 GB RAM machine do the reload, and monitor it with with the Windows Task Manager and see how much RAM the qv.exe process max's at.

Re: Is there any relation between OLEDB reload and RAM size?

bluecarbon — Thu, 08 Oct 2015 15:29:51 GMT

Hi.

I meant RAM of the computer that runs QV desktop. In my scenario, I m connecting to same DB using same connection type from two different machines and the time it takes is getting different. I m not sure if it has to do with RAM of the machine that runs QV desktop or is there any other factor that I m missing here.

Thanks,

Rakul.

Re: Is there any relation between OLEDB reload and RAM size?

bluecarbon — Thu, 08 Oct 2015 15:32:03 GMT

Hi,

In either of the machine the RAM or CPU usage is overloading. But still the reload time is much smaller in bigger RAM machine. So need to know what are all factors that contribute to QV Reload from QV desktop using OLEDB connection type.

Thanks,

Rakul.

Re: Is there any relation between OLEDB reload and RAM size?

Anonymous — Thu, 08 Oct 2015 15:40:58 GMT

Does not matter whether or not it is OLEDB or not.

The more you overload your RAM the slower it will get.

Re: Is there any relation between OLEDB reload and RAM size?

maxgro — Thu, 08 Oct 2015 15:49:20 GMT

is there the same (or similar) difference when you extract with a different tool (not Qlik)?

Re: Is there any relation between OLEDB reload and RAM size?

bluecarbon — Mon, 12 Oct 2015 19:21:06 GMT

Can I read your statement as, Bigger the RAM lesser the Reload time?

Thanks,

Rakul

Re: Is there any relation between OLEDB reload and RAM size?

Anonymous — Tue, 13 Oct 2015 08:57:58 GMT

Not exactly.

If the server runs short of RAM and starts swapping then things will get slower.

But if the server has enough RAM then adding more will make no difference.

Re: Is there any relation between OLEDB reload and RAM size?

qlikviewwizard — Tue, 13 Oct 2015 09:02:34 GMT

Hi,

You are using same connections. Are you using the same user credentials or different user?

Re: Is there any relation between OLEDB reload and RAM size?

rwunderlich — Tue, 13 Oct 2015 09:09:18 GMT

‌Reload duration can also be affected by number & speed of CPUs, and network connection speed between the QV desktop and the do. Are these factors different on these two machines?

Rob

Re: Is there any relation between OLEDB reload and RAM size?

bluecarbon — Wed, 14 Oct 2015 19:45:44 GMT

Hi Arjun,

Yes, I m using the same connections and same credentials.

Thanks,

Rakul.

Re: Is there any relation between OLEDB reload and RAM size?

bluecarbon — Wed, 14 Oct 2015 19:46:31 GMT

Yes,

When I try to retrieve the data using Toad there is a difference in time.

Thanks,

Rakul.

Re: Is there any relation between OLEDB reload and RAM size?

bluecarbon — Wed, 14 Oct 2015 19:48:32 GMT

Hi Rob,

Thanks for replying. So in my case, the reload speed is getting decreased when there is an increase in CPU. So can I come to a conclusion RAM comes into play only if the data that is getting reloaded exceeds the RAM size. Until then, with more CPUs lesser the reload time.

Thanks,

Rakul.