topic Re: Commencing ReduceData issue in QlikView

Commencing ReduceData issue

sifatnabil — Wed, 29 Apr 2015 02:25:28 GMT

Hi all,

I have an issue with a large document (around 10 million rows in total). On my PC (with 12 GM RAM 64 bit) it works fine (slowish on calculations in objects), and 100% QVD based. It takes 1 minute to load the 10 million rows of QVDs. However, on the production QlikView server, it takes one hour on this step:

“(2015-04-28 08:52:33) Information: Commencing ReduceData”

Any ideas on how to resolve this?

Re: Commencing ReduceData issue

marcus_sommer — Wed, 29 Apr 2015 10:46:49 GMT

I don't know what these message meant but it looks that the qv server hadn't enough cpu/ram ressources (have a look in the performance settings within the qmc and in the taskmanager) or the server pulled the data over a slow network. Then normally such qvd load is very fast.

- Marcus

Re: Commencing ReduceData issue

sifatnabil — Thu, 30 Apr 2015 02:53:44 GMT

Thanks Marcus, I also believe the issue was CPU usage, due to some high intensity calculations being done on objects over millions of rows (like with firstsortvalue()). My reasoning for this, is that I loaded a blank test file onto to the server with the exact same data, and it was able to load 11 million rows in 1 minute. But when done with the front-end objects, it produced that error and took 1 hour to load.

So I rebuilt the document from scratch, and optimized it such there are

1 dropped table
Only 8 variables
25 dropped fields
65 less objects
187 less expressions
RAM footprint reduced to 223 from 261 MB

And it successfully loads in 1 minute now.