Distribution Task Log File Help

mataylesbury — Thu, 04 Dec 2014 12:15:15 GMT

Hi,

I'm having trouble with a particular distribution task that distributes one of our apps. It doesn't do anything differently to other tasks that distribute apps to the same location & security groups, and its not particularly large in size (1.3GB) but it has started taking over 20 minutes to run. It used to take around 3 minutes, but suddenly started taking much longer.

When I look at the log for the Task, the bottleneck appears to be a line that says "...Information: Offer resources", Can anyone tell me what is actually happening at this point in the process? What does that line mean? And maybe even offer up a suggestion as to what might be causing the bottleneck at this step?

Many Thanks,

- Mathew

Re: Distribution Task Log File Help

Peter_Cammaert — Thu, 04 Dec 2014 12:28:24 GMT

Can you post the log in this thread? Can you provide a few details of the QlikView environment this task is running in (Publisher? Clustered? What version? How many jobs execute simultaneously? How many CPU cores?)

Thanks.

Peter

Re: Distribution Task Log File Help

mataylesbury — Wed, 10 Dec 2014 10:54:13 GMT

Hi Peter,

Thanks for the response and apologies for the delay in getting back to you. Here are some details:

Clustered environment.
1 x publisher server to handle the reloads.
2 x load-balanced application servers to serve the applications to users.
Job is running on a publisher server.
The task distributes the app out to a directory shared by publisher server from which the application servers load the app.
Limit of 12 simultaneous jobs. However, even if we run the distribute when no other jobs are running it still takes 20 mins.
QlikView 11.2. SR4.
Publisher has 2x10 core processors. So 20 cores.

Log file as follows:

(2014-12-08 05:23:14) Information: Starting task 'Distribute - Claims - Claim Analysis Dashboard'. Id:1a93f700-ebf9-41eb-a0d2-b8f6439c589c. Triggered by 'TaskCompletedTrigger'. Id:03f1c885-4b2e-492e-b0e8-0f52483ee1ca
(2014-12-08 05:23:14) Information: Entering Task Execution.
(2014-12-08 05:23:14) Information: ClusterID=1
(2014-12-08 05:23:14) Information: QDSID=bcf17ba7-d50b-0305-d0b8-d68fa137af13
(2014-12-08 05:23:14) Information: TaskID=1a93f700-ebf9-41eb-a0d2-b8f6439c589c
(2014-12-08 05:23:14) Information: MaxRunTime=1.00:00:00
(2014-12-08 05:23:14) Information: MachineName=HFX-L-QPUB01
(2014-12-08 05:23:14) Information: Max attempts:1
(2014-12-08 05:23:14) Information: Current Attempt=0
(2014-12-08 05:23:14) Information: Task Dependencies are OK
(2014-12-08 05:23:14) Information: Start document distribution.
(2014-12-08 05:23:14) Information: Opening source document
(2014-12-08 05:23:14) Information: Opening document: "Claim Analysis Dashboard.qvw"
(2014-12-08 05:23:14) Information: Allocating new QlikView Engine. Current usage count=6 of 12 (of type non-reader).
(2014-12-08 05:23:14) Information: Max retries:5
(2014-12-08 05:23:14) Information: Attempt:01
(2014-12-08 05:23:14) Information: Opened the QlikView Engine successfully. ProcessID=9536
(2014-12-08 05:23:14) Information: Allocated QlikView Engine successfully. Current usage count=7 of 12 (of type non-reader). Ticket number=176.
(2014-12-08 05:23:14) Information: Loading document "D:\QlikView Documents\Organisational\Claims\5_Application\Claim Analysis Dashboard.qvw" (1271.64 Mb)
(2014-12-08 05:23:15) Information: Loading. LoadTime=00:00:01.0141170
(2014-12-08 05:23:17) Information: Loading. LoadTime=00:00:03.0423510
(2014-12-08 05:23:21) Information: Loading. LoadTime=00:00:07.0988190
(2014-12-08 05:23:29) Information: Loading. LoadTime=00:00:15.2117550
(2014-12-08 05:23:46) Information: Loading. LoadTime=00:00:31.4376270
(2014-12-08 05:24:18) Information: Loading. LoadTime=00:01:03.8893710
(2014-12-08 05:24:38) Information: Physical FileSize=1271.64 Mb. Memory Allocation Delta for this file=9407.90 Mb. Available Physical Memory Before Open=294676.64 Mb. Available Physical Memory After Open=287049.13 Mb. Total Physical Memory=393181.27 Mb.
(2014-12-08 05:24:38) Information: Attempted to load the document with data.
(2014-12-08 05:24:38) Information: The document was loaded successfully.
(2014-12-08 05:24:44) Information: Disabling One and always one
(2014-12-08 05:25:19) Information: Reduce skipped, nothing is selected.
(2014-12-08 05:25:19) Information: Document was opened successfully
(2014-12-08 05:25:19) Information: Determined 3 static recipients spread over 1 Distribution Resources.
(2014-12-08 05:25:19) Information: Number of rule combinations was calculated successfully. Rounds=1
(2014-12-08 05:25:19) Information: Empty rules
(2014-12-08 05:25:19) Information: Rules resulted in distribution.
(2014-12-08 05:25:19) Information: ROUND: 0 of 1. WarningCount=0
(2014-12-08 05:25:19) Information: Building filename
(2014-12-08 05:25:19) Information: Destination name: Claim Analysis Dashboard.qvw
(2014-12-08 05:25:19) Information: Set script
(2014-12-08 05:25:19) Information: Resetting of the Document Script for the Distributed Document was successful. ScriptType=Clear
(2014-12-08 05:25:19) Information: Offer resources
(2014-12-08 05:44:42) Information: Enabling One and always one
(2014-12-08 05:44:42) Information: Commencing ClearSelections. FieldName=%AC_Name
(2014-12-08 05:44:42) Information: Adding selections for field %AC_Name. Values="Incurred"
(2014-12-08 05:44:42) Information: Commencing ClearSelections. FieldName=%Period1Code
(2014-12-08 05:44:42) Information: Adding selections for field %Period1Code. Values="YTD"
(2014-12-08 05:44:42) Information: Commencing ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\28e0c531-de30-4f0f-9773-cce64c76d081\document.qvw. (Reduce=False, Save=True)
(2014-12-08 05:46:05) Information: Completed ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\28e0c531-de30-4f0f-9773-cce64c76d081\document.qvw. (Reduce=False, Save=True)
(2014-12-08 05:46:05) Information: Memory Allocation Delta for this file=111.86 Mb. Available Physical Memory Before Reduce=288477.03 Mb. Available Physical Memory After Reduce=280707.14 Mb. Total Physical Memory=280707.14 Mb.
(2014-12-08 05:46:10) Information: Distributing
(2014-12-08 05:46:10) Information: Distributing using resource "Distribute - Claims - Claim Analysis Dashboard_Folder_1".
(2014-12-08 05:46:10) Information: Creating/Updating file: E:\QlikView Data\QlikView Documents\Organisational\Claims\5_Application\Claim Analysis Dashboard.qvw
(2014-12-08 05:46:11) Information: 100% - E:\QlikView Data\QlikView Documents\Organisational\Claims\5_Application\Claim Analysis Dashboard.qvw
(2014-12-08 05:46:11) Information: Performance data (CopyFile): FileSystemAccessRules=5 (0), Creating temporary file: E:\QlikView Data\QlikView Documents\Organisational\Claims\5_Application\Claim Analysis Dashboard.tmp (0), Temporary file written successfully. (1326), Deleting old destination file. (1326), Renaming temporary file to destination file. (1326), Write complete. (1342)
(2014-12-08 05:46:11) Information: Distribution finished successfully.
(2014-12-08 05:46:11) Information: Deleting temporary files.
(2014-12-08 05:46:11) Information: Closing the document.
(2014-12-08 05:46:13) Information: Closed the QlikView Engine successfully. ProcessID=9536
(2014-12-08 05:46:13) Information: Document distribution done.
(2014-12-08 05:46:13) Information: Task Execute Duration=00:22:59.1361065
(2014-12-08 05:46:13) Information: The task "Distribute - Claims - Claim Analysis Dashboard" finished successfully
(2014-12-08 05:46:13) Information: TaskResult.status=Finished
(2014-12-08 05:46:13) Information: Notifying all triggers of new state:Finished
(2014-12-08 05:46:13) Information: Notifying all triggers of new state:Finished - completed
(2014-12-08 05:46:13) Information: Saving Task Result

Re: Distribution Task Log File Help

bent_nielsen — Sat, 02 Dec 2017 21:41:57 GMT

We had a similar problem with one of our applications. We are running on Qlikview version QV12.1 SR8. It turned out, that within the application a bookmark was made. It took the loading time from 1.2 minutes to 3.5 hours.

Once the bookmark was removed, we were down to 1.2 minutes again.

So it seems as if the "offering resources" step has some kind of connection to bookmarks within the application. We don't know how, but removing the bookmark did the job.

topic Re: Distribution Task Log File Help in QlikView

Distribution Task Log File Help

Re: Distribution Task Log File Help

Re: Distribution Task Log File Help

Re: Distribution Task Log File Help