13 Replies Latest reply: Apr 27, 2016 4:15 AM by Colin Louch RSS

    After loading a QlikView App, the distribution just waits

    Colin Louch

      Has anybody any idea why the load and distribute of an app just seems to sit and wait for a long time?

       

      Using QV 11 on windows 2012 server

       

      Extract from log file below shows a wait of 28 minutes from when the document was ready to the start of publication.

      At one point this function was taking about 9 minutes in total, now it is around 40 minutes.

       

      I have removed all recipients and then re-installed them, but no difference, again the system just waits and waits

       

      (2015-04-07 12:42:38) Information: Set script

      (2015-04-07 12:42:38) Information: Resetting of the Document Script for the Distributed Document was successful. ScriptType=Clear

      (2015-04-07 12:42:38) Information: Offer resources

      (2015-04-07 13:10:45) Information: Commencing ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\b5458897-1e57-41b4-98d4-2f449136daca\document.qvw. (Reduce=False, Save=True)

      (2015-04-07 13:11:07) Information: Completed ReduceData for

        • Re: After loading a QlikView App, the distribution just waits
          Shiva Reddy

          as per my knowledge it's take some time to concatenate ur current data with ur old data files.

            • Re: After loading a QlikView App, the distribution just waits
              Colin Louch

              All data is loaded, I am simply doing a distribution at this point, so there is no concatenation of old and new data.

               

              I have run the job again now, and exactly the same has happened again -  a wait of 28 minutes.

               

              (2015-04-08 12:57:42) Information: Starting task 'Dist Customer Flow'. Id:88be9e52-bd91-4be5-a450-b6d9fbce639a. Triggered by 'ManualStartTrigger'. Id:00000001-0002-0003-0405-0607080a0b0c

              (2015-04-08 12:57:42) Information: Entering Task Execution.

              (2015-04-08 12:57:42) Information: ClusterID=1

              (2015-04-08 12:57:42) Information: QDSID=7f506414-bdca-c79b-8ac6-45e09c3a551e

              (2015-04-08 12:57:42) Information: TaskID=88be9e52-bd91-4be5-a450-b6d9fbce639a

              (2015-04-08 12:57:42) Information: MaxRunTime=1.00:00:00

              (2015-04-08 12:57:42) Information: MachineName=QVDMZ2P

              (2015-04-08 12:57:42) Information: Max attempts:1

              (2015-04-08 12:57:42) Information: Current Attempt=0

              (2015-04-08 12:57:42) Information: Task Dependencies are OK

              (2015-04-08 12:57:42) Information: RepeatVariable found.

              (2015-04-08 12:57:42) Information: Using RepeatVariable. Name: number_of_years_data_to_load, ValueCount: 1, Value(s) (Max 25): 3

              (2015-04-08 12:57:42) Information: Current RepeatVariable set. Name: number_of_years_data_to_load, Value: 3

              (2015-04-08 12:57:42) Information: Start document distribution.

              (2015-04-08 12:57:42) Information: Opening source document

              (2015-04-08 12:57:42) Information: Opening document: "Nyckeltalapp Customer Flow.qvw"

              (2015-04-08 12:57:42) Information: Allocating new QlikView Engine. Current usage count=0 of 4 (of type non-reader).

              (2015-04-08 12:57:42) Information: Max retries:5

              (2015-04-08 12:57:42) Information: Attempt:01

              (2015-04-08 12:57:42) Information: Opened the QlikView Engine successfully. ProcessID=1804

              (2015-04-08 12:57:42) Information: Allocated QlikView Engine successfully. Current usage count=1 of 4 (of type non-reader). Ticket number=6493.

              (2015-04-08 12:57:42) Information: Loading document "D:\QlikView Storage\Private Data\Source Documents\In Production\Documents\Nyckeltalapp Customer Flow.qvw" (1010.37 Mb)

              (2015-04-08 12:57:43) Information: Loading. LoadTime=00:00:01.0008897

              (2015-04-08 12:57:45) Information: Loading. LoadTime=00:00:03.0032477

              (2015-04-08 12:57:49) Information: Loading. LoadTime=00:00:07.0103875

              (2015-04-08 12:57:50) Information: Physical FileSize=1010.37 Mb. Memory Allocation Delta for this file=2818.23 Mb. Available Physical Memory Before Open=125507.96 Mb. Available Physical Memory After Open=122676.79 Mb. Total Physical Memory=131037.27 Mb.

              (2015-04-08 12:57:50) Information: Attempted to load the document with data.

              (2015-04-08 12:57:50) Information: The document was loaded successfully.

              (2015-04-08 12:57:51) Information: Reduce skipped, nothing is selected.

              (2015-04-08 12:57:51) Information: Document was opened successfully

              (2015-04-08 12:57:51) Information: Determined 15 static recipients spread over 1 Distribution Resources.

              (2015-04-08 12:57:51) Information: Number of rule combinations was calculated successfully. Rounds=1

              (2015-04-08 12:57:51) Information: Empty rules

              (2015-04-08 12:57:51) Information: Rules resulted in distribution.

              (2015-04-08 12:57:51) Information: ROUND: 0 of 1. WarningCount=0

              (2015-04-08 12:57:51) Information: Building filename

              (2015-04-08 12:57:51) Information: Destination name: Nyckeltalapp Customer Flow.qvw

              (2015-04-08 12:57:51) Information: Set script

              (2015-04-08 12:57:51) Information: Resetting of the Document Script for the Distributed Document was successful. ScriptType=Clear

              (2015-04-08 12:57:51) Information: Offer resources

              (2015-04-08 13:25:57) Information: Commencing ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\e8e2310d-fe8a-4404-bb4b-2a03a2655a71\document.qvw. (Reduce=False, Save=True)

              (2015-04-08 13:26:18) Information: Completed ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\e8e2310d-fe8a-4404-bb4b-2a03a2655a71\document.qvw. (Reduce=False, Save=True)

              (2015-04-08 13:26:18) Information: Memory Allocation Delta for this file=6.60 Mb. Available Physical Memory Before Reduce=122598.51 Mb. Available Physical Memory After Reduce=122096.79 Mb. Total Physical Memory=122096.79 Mb.

              (2015-04-08 13:26:19) Information: Distributing

              (2015-04-08 13:26:19) Information: Distributing using resource "Dist Customer Flow_QVS_1".

              (2015-04-08 13:26:19) Information: Trying to distribute. QVS=qvp://qvfe2p/

              (2015-04-08 13:26:19) Information: Connecting to QlikView Server. Address=qvfe2p:4747

              (2015-04-08 13:26:19) Information: Successfully connected to QlikView Server. Address=qvfe2p:4747

              (2015-04-08 13:26:19) Information: Creating/Updating file: qvp://qvfe2p/AccessPoint Documents/Nyckeltalapp Customer Flow.qvw

               

              At this point the distrbution runs without problems.

               

              Should I remove the document from Access Point or something like that?

               

              /Colin

            • Re: After loading a QlikView App, the distribution just waits
              Magnus Lovsten

              You can enable Trace logging to get more details between the two logged lines (done in the config file of the Distribution Service).  Warning! This will increase logging dramatically. Please just enable it temporarily to figure the issue and then disable again.

               

              You will now see logged Information rows stating with "TRACE". Also there are a number of new log files created on disc in the same folder as the TaskLog.txt.

               

              I hope this can help you to identify what is taking so much time.

                • Re: After loading a QlikView App, the distribution just waits
                  Colin Louch

                  I have now run a load with the TRACE enabled but cannot see any helpful information from the log file:

                   

                  (2015-04-22 14:38:36) Information: TRACE:DumpDistributionRequest Begin

                  (2015-04-22 14:38:36) Information: TRACE:DumpDistributionRequest End

                  (2015-04-22 14:38:36) Information: TRACE:PopulateDistribution Begin

                  (2015-04-22 14:38:36) Information: TRACE:BeginGetstreams Begin

                  (2015-04-22 15:06:59) Information: TRACE:BeginGetstreams End

                  (2015-04-22 15:06:59) Information: TRACE:GrabQVWFile Begin (Nyckeltalapp Customer Flow.qvw)

                  (2015-04-22 15:06:59) Information: TRACE:GetDocumentPackage Begin (Retry #1)

                  (2015-04-22 15:06:59) Information: TRACE:GrabFilesFromQVBWrapper Begin

                  (2015-04-22 15:06:59) Information: TRACE:GetStream Begin

                  (2015-04-22 15:06:59) Information: TRACE:ReduceData Begin

                  (2015-04-22 15:06:59) Information: Commencing ReduceData for C:\ProgramData\QlikTech\DistributionService\1\temp\b8ce1055-bf6d-4881-b54f-9338f919410f\document.qvw. (Reduce=False, Save=True)

                   

                  There still appears a 28 minute idle time.

                   

                  /Colin

                • Re: After loading a QlikView App, the distribution just waits
                  greddy y v

                  Hi Colin,

                   

                  I am facing similar kind of issue for one of the application ..

                   

                  Waiting almost 2 hrs at offer resources and application getting posted to access point after that.

                   

                  Can you please let me know if if you were able to resolve the issue or find out the reason for this ?

                   

                  Thanks

                  Ganga

                    • Re: After loading a QlikView App, the distribution just waits
                      greddy y v

                      Any suggestions on this please ???

                      • Re: After loading a QlikView App, the distribution just waits
                        Colin Louch

                        I have never had a definitive answer - we were on the way to send the app to Qlik support, but I managed to optimize the app.

                         

                        I had a lot of actions "on change" of fields etc.  I had triggers on load of application etc.  It appears that this, although Publisher should not do anything at this point, actually does!  Quite what I do not know.

                         

                        So my solution has been to take away all of these actions, and on the first sheet have a Button/Text Object with the required actions.  It may take a while for the desired effect to be made (show the next sheet with selections) but at least the distribution is faster.

                         

                        Unfortunately it was a year ago that I started this thread, so I am a bit rusty in my recollection of the events, but I also managed to simplify the data that was loaded - used P() and E() functions in set analysis in a better way.

                         

                        The app has many variables, so I suspect that there is something in Publisher that "checks" things prior to distribution.

                         

                        I hope this helps, but repost if it is not your solution and I can look at my app again to get a better idea of what I did

                         

                        /Colin