topic Re: Performance issues - Slow load of document in QlikView

Performance issues - Slow load of document

Mon, 26 Jan 2026 18:19:17 GMT

Hello,

I have a SourceDocument which contains 220 million rows and has a size of 11GB (None compression)

This document is splitted out into almost 75 Document files, which one user only has access to.

This means the largest document i have is approx on 1gb - Most of them are on 100mb or so - And my expressions are not that complex.

But when the user wants to see the documents they are acting really slow - Too slow in my opinion.

My server specs are:

132GB ram

12 CORE AMD Opterib 2.1ghz

64bit Windows 2008 R2 server

What can be done?

Re: Performance issues - Slow load of document

marcus_sommer — Wed, 04 Jun 2014 10:10:05 GMT

How is your data-model - several fact-tables with a link-table or a single fact-table. Both approaches have advantages and disadvantages. Beside reducing unnecessary fields and rows could be a split from high-cardinality fields save RAM. Also section access caused longer load-times.

- Marcus

Re: Performance issues - Slow load of document

Wed, 04 Jun 2014 10:32:01 GMT

Single fact table with only a mastercalendar attached to it.

Re: Performance issues - Slow load of document

marcus_sommer — Wed, 04 Jun 2014 10:48:04 GMT

Are there fields with many unique values like a row-id, a timestamp, serial-numbers or similar? Is section access in the application?

- Marcus

Re: Performance issues - Slow load of document

Wed, 04 Jun 2014 10:50:33 GMT

There is no section access.

Yes i have a timestamp for each row. So there is many unique values. I also have an row-id for each row.

Re: Performance issues - Slow load of document

marcus_sommer — Wed, 04 Jun 2014 11:02:51 GMT

That's good - so you have a great potential to reduce the RAM requirement. Split your timestamp in date and time:

floor(timestamp) as date,

frac(timestamp) as time

If you needed your timestamp in an object you could simply make: date + time. Further I assume your row-id won't be used from users and served only development-reasons - I would it to comment out.

- Marcus

Re: Performance issues - Slow load of document

Wed, 04 Jun 2014 12:00:37 GMT

Hi Thomas,

To clarify.

You have 75 different users accessing one document each? Have you thought about using SECTION ACCESS and having one document?

How much memory is being used on the server when you have issues? How much CPU is being used?

Can you define SLOW? Is it charts taking time to update, sitting with hourglass and progress bar, or the documents take too long to load?

In development when you have not split the document out to 75 pieces, is response ok?

The answers to the above will help others understand your issue and will therefore moer likely to offer help.

Also I totally agree with the other comments posted here about TIMESTAMP, each tends to be unique so they do not compress, however dates and times are relatively low in number in most documents.

Richard

Re: Performance issues - Slow load of document

Wed, 04 Jun 2014 12:04:04 GMT

I have one masterdocument which is splitted out to 75 customer documents (only containg the one customers data which also is added to the document)

They access the document through a webticket.

No hourglass and progress bar on the charts. Its just slow to show me all the graphic. Eg. when i change sheet.

Response in clienttool is okay, no matter if i have not splitted my document or i have.

Re: Performance issues - Slow load of document

Peter_Cammaert — Wed, 04 Jun 2014 12:09:15 GMT

In the QlikView Design Blog, Miguel wrote a nice article about the impact of reducing unique field values on document size (both on disk and in RAM). These apparently simple changes cause an immediate performance increase. Well worth your time:

http://community.qlik.com/blogs/qlikviewdesignblog/2014/03/11/the-importance-of-being-distinct

Re: Performance issues - Slow load of document

shane_spencer — Wed, 04 Jun 2014 14:14:44 GMT

Thomas do you have a lot of charts on a single sheet? Multiple charts will take longer to update. You could use tabs to change between charts so only the one is shown at a time.

Re: Performance issues - Slow load of document

marcus_sommer — Wed, 04 Jun 2014 14:29:13 GMT

In addition to my former posting - to save certain selections and/or set certain selection by switching from sheet to sheet reduced the amount of calculation. A further possibility could be to set conditions for calculations or visibilties for objects/dimensions/expressions.

- Marcus