Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
Need help with below script,
LOAD
text(left(RENTALSTOCKID,4)) as [Resource No],
RENTALSTOCKID
FROM
[$(vFetchpath)RSTRENTALSTOCK.qvd]
(qvd) Where len(RENTALSTOCKID)=6 and index(RENTALSTOCKID,'/')=5;
Now our the field RENTALSTOCKID is 5 digits also. can someone suggest the change in the script please.
I have attatched the screenshot of the application where the RENTALSTOCKID 30025 should not comes under 3002.
Thanks Mark,
I am sending you the log of the schedule task, this log can help in understanding the delay.
Stage 2/MIP 2015_Maker.qvw |
Select Log: 2024-06-28 09:48:49 2024-06-27 03:24:06 2024-06-26 08:40:58 2024-06-25 12:00:20 2024-06-24 06:14:30 2024-06-23 03:22:54 2024-06-22 09:08:49 2024-06-21 07:52:17 2024-06-21 05:28:43 2024-06-20 17:15:36 2024-06-20 08:44:25 2024-06-19 10:27:41 2024-06-19 06:33:49 2024-06-18 07:29:51 2024-06-18 06:15:40 2024-06-17 05:31:04 2024-06-16 06:47:15 2024-06-14 03:40:43 2024-06-13 03:11:27 2024-06-12 07:34:00 2024-06-11 05:18:32 2024-06-10 12:36:20 2024-06-09 08:18:29 2024-06-08 08:18:00 2024-06-07 08:17:23 2024-06-06 03:41:45 2024-06-05 06:48:54 2024-06-04 03:23:57 2024-06-03 03:28:42 2024-06-02 03:45:14 2024-05-31 03:09:17 2024-05-30 06:08:56 (2024-06-27 03:24:06) Information: Starting task 'Stage 2/MIP 2015_Maker.qvw'. Id:3df1714f-c418-4126-8842-caa52e121c42. Triggered by 'TaskCompletedTrigger'. Id:303d86d5-afc3-4ed8-b8dc-4685f798c719 (2024-06-27 03:24:06) Information: Entering Task Execution. (2024-06-27 03:24:06) Information: ClusterID=1 (2024-06-27 03:24:06) Information: QDSID=cb05bcf5-5dc2-99a8-2003-2839aeff2b4e (2024-06-27 03:24:06) Information: TaskID=3df1714f-c418-4126-8842-caa52e121c42 (2024-06-27 03:24:06) Information: MaxRunTime=11:16:00 (2024-06-27 03:24:06) Information: MachineName=SARWOLVM064 (2024-06-27 03:24:06) Information: Max attempts:1 (2024-06-27 03:24:06) Information: Current Attempt=0 (2024-06-27 03:24:06) Information: Task Dependencies are OK (2024-06-27 03:24:06) Information: Document is marked to be Reloaded with fresh data. Initializing Reload for Distribution. (2024-06-27 03:24:06) Information: Opening "\\10.10.1.64\D$\QLIKVIEW\STAGE2\MIP 2015_Maker.qvw" (2024-06-27 03:24:08) Information: Allocating new QlikView Engine. Current usage count=1 of 5 (of type non-reader). (2024-06-27 03:24:08) Information: Max retries:5 (2024-06-27 03:24:08) Information: Attempt:01 (2024-06-27 03:24:09) Information: Opened the QlikView Engine successfully. ProcessID=23536 (2024-06-27 03:24:09) Information: Allocated QlikView Engine successfully. Current usage count=2 of 5 (of type non-reader). Ticket number=204. (2024-06-27 03:24:09) Information: Loading document "\\10.10.1.64\D$\QLIKVIEW\STAGE2\MIP 2015_Maker.qvw" (1170.84 Mb) (2024-06-27 03:24:10) Information: Physical FileSize=1170.84 Mb. Memory Allocation Delta for this file=23.73 Mb. Available Physical Memory Before Open=249645.22 Mb. Available Physical Memory After Open=249561.25 Mb. Total Physical Memory=258047.43 Mb. (2024-06-27 03:24:10) Information: Attempted to load the document without data. (2024-06-27 03:24:10) Information: The document was loaded successfully. (2024-06-27 03:24:10) Information: Document was opened successfully (2024-06-27 03:24:10) Information: Starting reload (2024-06-27 03:24:10) Information: QlikView->Settings->Document Peferences->Generate Logfile in document is set. Enabling Log Copier. (2024-06-27 03:24:10) Information: The Source Document is being reloaded. DocumentPath=\\10.10.1.64\D$\QLIKVIEW\STAGE2\MIP 2015_Maker.qvw (2024-06-27 03:24:10) Information: Waiting for the document log "\\10.10.1.64\D$\QLIKVIEW\STAGE2\MIP 2015_Maker.qvw" to become available.. Check until 27/06/2024 3:24:40 (2024-06-27 03:24:10) Information: Found a document log. FileName=\\10.10.1.64\D$\QLIKVIEW\STAGE2\MIP 2015_Maker.qvw.log (2024-06-27 03:24:10) Information: Writing documentLog to C:\ProgramData\QlikTech\DistributionService\1\Log\20240627\032406 - Stage 2_MIP 2015_Maker.qvw\DocumentLog.txt (2024-06-27 03:24:11) Information: Reloading. (2024-06 |
-27 03:24:12) Information: Reloading..
(2024-06-27 03:24:13) Information: Reloading...
(2024-06-27 03:24:14) Information: Reloading....
(2024-06-27 03:24:15) Information: Reloading.....
(2024-06-27 03:24:16) Information: Reloading......
(2024-06-27 03:24:17) Information: Reloading.......
(2024-06-27 03:24:18) Information: Reloading........
(2024-06-27 03:24:19) Information: Reloading.........
(2024-06-27 03:24:20) Information: Reloading..........
(2024-06-27 03:24:21) Information: Slow down logging. Log every <2> seconds.
(2024-06-27 03:24:21) Information: Reloading
(2024-06-27 03:24:23) Information: Reloading.
(2024-06-27 03:24:25) Information: Reloading..
(2024-06-27 03:24:27) Information: Reloading...
(2024-06-27 03:24:29) Information: Reloading....
(2024-06-27 03:24:31) Information: Reloading.....
(2024-06-27 03:24:33) Information: Reloading......
(2024-06-27 03:24:35) Information: Reloading.......
(2024-06-27 03:24:37) Information: Reloading........
(2024-06-27 03:24:39) Information: Reloading.........
(2024-06-27 03:24:41) Information: Reloading..........
(2024-06-27 03:24:43) Information: Slow down logging. Log every <10> seconds.
(2024-06-27 03:24:43) Information: Reloading
(2024-06-27 03:24:53) Information: Reloading.
(2024-06-27 03:25:03) Information: Reloading..
(2024-06-27 03:25:13) Information: Reloading...
(2024-06-27 03:25:23) Information: Reloading....
(2024-06-27 03:25:33) Information: Reloading.....
(2024-06-27 03:25:43) Information: Reloading......
(2024-06-27 03:25:53) Information: Reloading.......
(2024-06-27 03:26:04) Information: Reloading........
(2024-06-27 03:26:14) Information: Reloading.........
(2024-06-27 03:26:24) Information: Reloading..........
(2024-06-27 03:26:34) Information: Slow down logging. Log every <60> seconds.
(2024-06-27 03:26:34) Information: Reloading
(2024-06-27 03:27:34) Information: Reloading.
(2024-06-27 03:28:34) Information: Reloading..
(2024-06-27 03:29:35) Information: Reloading...
(2024-06-27 03:30:35) Information: Reloading....
(2024-06-27 03:31:35) Information: Reloading.....
(2024-06-27 03:32:35) Information: Reloading......
(2024-06-27 03:33:35) Information: Reloading.......
(2024-06-27 03:34:36) Information: Reloading........
(2024-06-27 03:35:36) Information: Reloading.........
(2024-06-27 03:36:36) Information: Reloading..........
(2024-06-27 03:37:36) Information: Slow down logging. Log every <300> seconds.
(2024-06-27 03:37:36) Information: Reloading
(2024-06-27 03:42:37) Information: Reloading.
(2024-06-27 03:47:38) Information: Reloading..
(2024-06-27 03:52:39) Information: Reloading...
(2024-06-27 03:57:40) Information: Reloading....
(2024-06-27 04:02:42) Information: Reloading.....
(2024-06-27 04:07:43) Information: Reloading......
(2024-06-27 04:12:44) Information: Reloading.......
(2024-06-27 04:17:45) Information: Reloading........
(2024-06-27 04:22:46) Information: Reloading.........
(2024-06-27 04:27:47) Information: Reloading..........
(2024-06-27 04:32:48) Information: Slow down logging. Log every <600> seconds.
(2024-06-27 04:32:48) Information: Reloading
(2024-06-27 04:42:50) Information: Reloading.
(2024-06-27 04:52:52) Information: Reloading..
(2024-06-27 05:02:55) Information: Reloading...
(2024-06-27 05:12:58) Information: Reloading....
(2024-06-27 05:22:59) Information: Reloading.....
(2024-06-27 05:33:01) Information: Reloading......
(2024-06-27 05:43:03) Information: Reloading.......
(2024-06-27 05:53:05) Information: Reloading........
(2024-06-27 06:03:08) Information: Reloading.........
(2024-06-27 06:13:10) Information: Reloading..........
(2024-06-27 06:23:12) Information: Slow down logging. Log every <900> seconds.
(2024-06-27 06:23:12) Information: Reloading
(2024-06-27 06:38:15) Information: Reloading.
(2024-06-27 06:53:18) Information: Reloading..
(2024-06-27 07:08:22) Information: Reloading...
(2024-06-27 07:23:25) Information: Reloading....
(2024-06-27 07:38:28) Information: Reloading.....
(2024-06-27 07:53:32) Information: Reloading......
(2024-06-27 08:08:36) Information: Reloading.......
(2024-06-27 08:23:40) Information: Reloading........
(2024-06-27 08:38:43) Information: Reloading.........
(2024-06-27 08:53:45) Information: Reloading..........
(2024-06-27 09:08:49) Information: Slow down logging. Log every <1200> seconds.
(2024-06-27 09:08:49) Information: Reloading
(2024-06-27 09:28:54) Information: Reloading.
(2024-06-27 09:48:58) Information: Reloading..
(2024-06-27 10:09:04) Information: Reloading...
(2024-06-27 10:29:09) Information: Reloading....
(2024-06-27 10:49:14) Information: Reloading.....
(2024-06-27 11:09:19) Information: Reloading......
(2024-06-27 11:17:39) Information: The Source Document reload complete. DocumentPath=\\10.10.1.64\D$\QLIKVIEW\STAGE2\MIP 2015_Maker.qvw
(2024-06-27 11:17:39) Information: Memory Allocation Delta for this file=22557.20 Mb. Available Physical Memory Before Reload=249559.45 Mb. Available Physical Memory After Reload=144159.32 Mb. Total Physical Memory=144159.32 Mb.
(2024-06-27 11:17:40) Information: The Source Document was reloaded successfully.
(2024-06-27 11:17:40) Information: Reload finished successfully
(2024-06-27 11:17:40) Information: Start saving document
(2024-06-27 11:18:35) Information: Check in document: \\10.10.1.64\D$\QLIKVIEW\STAGE2\MIP 2015_Maker.qvw
(2024-06-27 11:18:35) Information: Closing the document.
(2024-06-27 11:18:39) Information: Closed the QlikView Engine successfully. ProcessID=23536
(2024-06-27 11:18:39) Information: No distribution required.
(2024-06-27 11:18:39) Information: Task Execute Duration=07:54:32.9020496
(2024-06-27 11:18:39) Information: The task "Stage 2/MIP 2015_Maker.qvw" finished successfully
(2024-06-27 11:18:39) Information: TaskResult.status=Finished
(2024-06-27 11:18:39) Information: Notifying all triggers of new state:Finished
(2024-06-27 11:18:39) Information: Notifying all triggers of new state:Finished - completed
(2024-06-27 11:18:39) Information: Saving Task Result
Thank you @Rajiv-Dharia. We can't see much from the QMC Logs besides the duration and memory allocated. Your app really has at the end around 18GB?
Overall tips you can try to reduce the reload time:
- Only load the rows and columns that you really need
- Try to bring the QVDs as ready as possible, just to load them, preferably optimized. Maybe you can do some of the heavy lifting in other QVD Builder apps running them in parallel. Your dashboard app will be just about loading the QVDs as fast as possible.
- Use AutoNumber in your key fields, this can reduce the size of your app drastically
Read more at Data Voyagers - datavoyagers.net
Follow me on my LinkedIn | Know IPC Global at ipc-global.com
It's only the task-log with the results of the task - but not what happens within the load. Therefore take a look in the document-log which will show which single load needs how much time and how many source- and target-records it has had.
Quite clear is already from the task-log that your system has enough RAM. Further, saving the application needs around 1 minute - which could be taken as hint for possible causes, depending on the amount of data which were included.