Qlik Community

QlikView Publisher

Discussion Board for collaboration on QlikView Publisher.

Not applicable

Reload is fast, but Distribution is slow on large QVW

Hello QlikView Community!!

Need help understanding how the Distribution Service works.   I have a 2GB QVW file that reloads under 3 minutes.  This is perfectly acceptable for our purpose.  However when the publisher attempts to distributes this file, it takes close to 1 hour to distribute.   Both the Server and the Publisher is on the same Windows 2008 server with 190GB ram (12 core).  I don't believe hardware is the issue.  We have enough memory to support.

By looking at the log file, it seems as thought the publisher is writing in increments via buffer to upload to a directory on the same physical server (end user document).   If I manually copy and past the 2GB file its very fast,   but letting the publisher do the work, its very slow.

Could we increase the buffer size and how would I do this?   Any other tips to increase performance of the DistributionService?   I've already set the QV Engine to 9 as recommended.

Regards

Mike

6 Replies
rva_heldendaten
Contributor III

Re: Reload is fast, but Distribution is slow on large QVW

HI!

If its on the same machine, would it be possible to "Distribute to a Folder" instead?

The one drawback I see is, that the .qvw.meta-File is not written. So you can't make use of Accesspoint-Categories, etc...

QlikView Management Console - Mozilla Firefox_2013-01-10_18-16-50.png

Not applicable

Re: Reload is fast, but Distribution is slow on large QVW

In theory could we do this.

1.  For the first time setting up a QVW on access point, distribute it on server.

2.  Once that is done and the proper category is created on access point,  the proper   qvw.Meta file is already generated.

3.   Modify my reload task, so that instead of distributing it over to server, distribute it to folder.  This would just overwrite the QVW and not the .META file which is okay since I don't excpect much content to change in the qvwMeta file

Would this be right?

rva_heldendaten
Contributor III

Re: Reload is fast, but Distribution is slow on large QVW

Yes right;

Just one limitation: When I remember correctly, the "Last reload"-Time is stored in the .META-file as well. So Accesspoint will always show the date of your "Step 1.".

Not applicable

Re: Reload is fast, but Distribution is slow on large QVW

Yes you are right, i just confirmed this.

Any any to attach an API call to modify the meta-file?  so that it shows the last time it was refreshed via "distributed to folder"

rva_heldendaten
Contributor III

Re: Reload is fast, but Distribution is slow on large QVW

Unfortunately not

.qvw.shared and .qvw.meta-Files are internal files without any API..

nowadays .qvw.shared files can be "managed" with QV Power Tools (http://community.qlik.com/docs/DOC-3059), but I don't think they include any functionality for .qvw.meta files..

jason_michaelid
Honored Contributor II

Re: Reload is fast, but Distribution is slow on large QVW

You could always add a line at the end of your script:

LET vReloadTime = Now();

Then use this variable in the UI instead of ReloadTime()

Hope this helps,

Jason

Community Browser