After loading a QlikView App, the distribution just waits

[#1]

Has anybody any idea why the load and distribute of an app just seems to sit and wait for a long time?

Using QV 11 on windows 2012 server

Extract from log file below shows a wait of 28 minutes from when the document was ready to the start of publication.

At one point this function was taking about 9 minutes in total, now it is around 40 minutes.

I have removed all recipients and then re-installed them, but no difference, again the system just waits and waits

(2015-04-07 12:42:38) Information: Set script

(2015-04-07 12:42:38) Information: Resetting of the Document Script for the Distributed Document was successful. ScriptType=Clear

(2015-04-07 12:42:38) Information: Offer resources

(2015-04-07 13:10:45) Information: Commencing ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\b5458897-1e57-41b4-98d4-2f449136daca\document.qvw. (Reduce=False, Save=True)

(2015-04-07 13:11:07) Information: Completed ReduceData for

[buzzy996]

as per my knowledge it's take some time to concatenate ur current data with ur old data files.

[#3]

All data is loaded, I am simply doing a distribution at this point, so there is no concatenation of old and new data.

I have run the job again now, and exactly the same has happened again -  a wait of 28 minutes.

(2015-04-08 12:57:42) Information: Starting task 'Dist Customer Flow'. Id:88be9e52-bd91-4be5-a450-b6d9fbce639a. Triggered by 'ManualStartTrigger'. Id:00000001-0002-0003-0405-0607080a0b0c

(2015-04-08 12:57:42) Information: Entering Task Execution.

(2015-04-08 12:57:42) Information: ClusterID=1

(2015-04-08 12:57:42) Information: QDSID=7f506414-bdca-c79b-8ac6-45e09c3a551e

(2015-04-08 12:57:42) Information: TaskID=88be9e52-bd91-4be5-a450-b6d9fbce639a

(2015-04-08 12:57:42) Information: MaxRunTime=1.00:00:00

(2015-04-08 12:57:42) Information: MachineName=QVDMZ2P

(2015-04-08 12:57:42) Information: Max attempts:1

(2015-04-08 12:57:42) Information: Current Attempt=0

(2015-04-08 12:57:42) Information: Task Dependencies are OK

(2015-04-08 12:57:42) Information: RepeatVariable found.

(2015-04-08 12:57:42) Information: Using RepeatVariable. Name: number_of_years_data_to_load, ValueCount: 1, Value(s) (Max 25): 3

(2015-04-08 12:57:42) Information: Current RepeatVariable set. Name: number_of_years_data_to_load, Value: 3

(2015-04-08 12:57:42) Information: Start document distribution.

(2015-04-08 12:57:42) Information: Opening source document

(2015-04-08 12:57:42) Information: Opening document: "Nyckeltalapp Customer Flow.qvw"

(2015-04-08 12:57:42) Information: Allocating new QlikView Engine. Current usage count=0 of 4 (of type non-reader).

(2015-04-08 12:57:42) Information: Max retries:5

(2015-04-08 12:57:42) Information: Attempt:01

(2015-04-08 12:57:42) Information: Opened the QlikView Engine successfully. ProcessID=1804

(2015-04-08 12:57:42) Information: Allocated QlikView Engine successfully. Current usage count=1 of 4 (of type non-reader). Ticket number=6493.

(2015-04-08 12:57:42) Information: Loading document "D:\QlikView Storage\Private Data\Source Documents\In Production\Documents\Nyckeltalapp Customer Flow.qvw" (1010.37 Mb)

(2015-04-08 12:57:43) Information: Loading. LoadTime=00:00:01.0008897

(2015-04-08 12:57:45) Information: Loading. LoadTime=00:00:03.0032477

(2015-04-08 12:57:49) Information: Loading. LoadTime=00:00:07.0103875

(2015-04-08 12:57:50) Information: Physical FileSize=1010.37 Mb. Memory Allocation Delta for this file=2818.23 Mb. Available Physical Memory Before Open=125507.96 Mb. Available Physical Memory After Open=122676.79 Mb. Total Physical Memory=131037.27 Mb.

(2015-04-08 12:57:50) Information: Attempted to load the document with data.

(2015-04-08 12:57:50) Information: The document was loaded successfully.

(2015-04-08 12:57:51) Information: Reduce skipped, nothing is selected.

(2015-04-08 12:57:51) Information: Document was opened successfully

(2015-04-08 12:57:51) Information: Determined 15 static recipients spread over 1 Distribution Resources.

(2015-04-08 12:57:51) Information: Number of rule combinations was calculated successfully. Rounds=1

(2015-04-08 12:57:51) Information: Empty rules

(2015-04-08 12:57:51) Information: Rules resulted in distribution.

(2015-04-08 12:57:51) Information: ROUND: 0 of 1. WarningCount=0

(2015-04-08 12:57:51) Information: Building filename

(2015-04-08 12:57:51) Information: Destination name: Nyckeltalapp Customer Flow.qvw

(2015-04-08 12:57:51) Information: Set script

(2015-04-08 12:57:51) Information: Resetting of the Document Script for the Distributed Document was successful. ScriptType=Clear

(2015-04-08 12:57:51) Information: Offer resources

(2015-04-08 13:25:57) Information: Commencing ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\e8e2310d-fe8a-4404-bb4b-2a03a2655a71\document.qvw. (Reduce=False, Save=True)

(2015-04-08 13:26:18) Information: Completed ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\e8e2310d-fe8a-4404-bb4b-2a03a2655a71\document.qvw. (Reduce=False, Save=True)

(2015-04-08 13:26:18) Information: Memory Allocation Delta for this file=6.60 Mb. Available Physical Memory Before Reduce=122598.51 Mb. Available Physical Memory After Reduce=122096.79 Mb. Total Physical Memory=122096.79 Mb.

(2015-04-08 13:26:19) Information: Distributing

(2015-04-08 13:26:19) Information: Distributing using resource "Dist Customer Flow_QVS_1".

(2015-04-08 13:26:19) Information: Trying to distribute. QVS=qvp://qvfe2p/

(2015-04-08 13:26:19) Information: Connecting to QlikView Server. Address=qvfe2p:4747

(2015-04-08 13:26:19) Information: Successfully connected to QlikView Server. Address=qvfe2p:4747

(2015-04-08 13:26:19) Information: Creating/Updating file: qvp://qvfe2p/AccessPoint Documents/Nyckeltalapp Customer Flow.qvw

At this point the distrbution runs without problems.

Should I remove the document from Access Point or something like that?

/Colin

[buzzy996]

sorry,not sure...,let see some one will answer here..

i'm suspecting abt this to understand...

(2015-04-08 12:57:51) Information: Offer resources

(2015-04-08 13:25:57) Information: Commencing ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\e8e2310d-fe8a-4404-bb4b-2a03a2655a71\document.qvw. (Reduce=False, Save=True)

[#5]

You can enable Trace logging to get more details between the two logged lines (done in the config file of the Distribution Service).  Warning! This will increase logging dramatically. Please just enable it temporarily to figure the issue and then disable again.

You will now see logged Information rows stating with "TRACE". Also there are a number of new log files created on disc in the same folder as the TaskLog.txt.

I hope this can help you to identify what is taking so much time.

[#6]

I have now run a load with the TRACE enabled but cannot see any helpful information from the log file:

(2015-04-22 14:38:36) Information: TRACE:DumpDistributionRequest Begin

(2015-04-22 14:38:36) Information: TRACE:DumpDistributionRequest End

(2015-04-22 14:38:36) Information: TRACE:PopulateDistribution Begin

(2015-04-22 14:38:36) Information: TRACE:BeginGetstreams Begin

(2015-04-22 15:06:59) Information: TRACE:BeginGetstreams End

(2015-04-22 15:06:59) Information: TRACE:GrabQVWFile Begin (Nyckeltalapp Customer Flow.qvw)

(2015-04-22 15:06:59) Information: TRACE:GetDocumentPackage Begin (Retry #1)

(2015-04-22 15:06:59) Information: TRACE:GrabFilesFromQVBWrapper Begin

(2015-04-22 15:06:59) Information: TRACE:GetStream Begin

(2015-04-22 15:06:59) Information: TRACE:ReduceData Begin

(2015-04-22 15:06:59) Information: Commencing ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\b8ce1055-bf6d-4881-b54f-9338f919410f\document.qvw. (Reduce=False, Save=True)

There still appears a 28 minute idle time.

/Colin

[#7]

The time is all used in BeginEndstreams.

What happens here is three things:

Reset Bookmarks - if you don't have any this will do nothing

Handle Always One Selected - if you don't use this this will do nothing

Create folder where the document will be saved.

I would recommend you trying to remove bookmarks and/or Always one selected to get you closer to find out what is tha root cause.

Hopefully this will get you closer to the answer.

[#8]

The only thing that I can see that is different from other apps is that in this one I have added to "Document Properties" "Field Event Triggers".

For 3 fields I have added Actions when OnSelect, but surely these are only activated by the user making a selection, not in Publisher?

I have now removed a non-used macro (now empty) and also removed hidden sheets.

Again the load and distribute has taken 28 minutes...

Otherwise,
I have no bookmarks.

I am unsure as to what you mean by "Handle Always One Selected".

The folder for saving the document is the same as for all other documents

[#9]

Make sure that you don't have any Listbox which has checked "Always One Selected Value".

And you are right, events triggers should not come in to play for Publisher.

[#10]

No list boxes have "Always One Selected Value".

I have created a copy of the app, and loaded in exactly the same way as the original.

No effect - still 28 minute delay.

Next - I have removed all of the Actions on Event triggers and still I have a 28 minute wait.

What more can I remove that may or may not affect this?