Opening a QV File takes 30 minutes...

[hugmarcel]

Hi,

Since yesterday opening of a big QV Files takes much longer than the day before, with QV Desktop.

The same can be observed when scheduling the document with a task in the QMC console. Extract of the logfile is:

(2015-04-29 06:44:15) Information: Reloading......

(2015-04-29 06:49:20) Information: Reloading.......

(2015-04-29 06:54:24) Information: Reloading........

(2015-04-29 06:59:28) Information: Reloading.........

(2015-04-29 07:00:57) Information: The Source Document partial reload complete. DocumentPath=E:\QVSchedule\UAT\DOC.qvw

(2015-04-29 07:00:57) Information: Memory Allocation Delta for this file=6377.34 Mb. Available Physical Memory Before Reload=451801.94 Mb. Available Physical Memory After Reload=479889.36 Mb. Total Physical Memory=479889.36 Mb.

(2015-04-29 07:01:05) Information: The Source Document was reloaded successfully.

(2015-04-29 07:01:05) Information: Reload finished successfully

(2015-04-29 07:01:05) Information: Start saving document

(2015-04-29 07:06:11) Information: Check in document: E:\QVSchedule\UAT\DOC.qvw(2015-04-29 07:06:11) Information: Closing the document.

(2015-04-29 07:06:13) Information: Closed the QlikView Engine successfully. ProcessID=25256

(2015-04-29 07:06:13) Information: Start document distribution.

(2015-04-29 07:06:13) Information: Opening source document

(2015-04-29 07:06:13) Information: Opening document: "DOC.qvw"

(2015-04-29 07:06:13) Information: Allocating new QlikView Engine. Current usage count=4 of 21 (of type non-reader).

(2015-04-29 07:06:13) Information: Max retries:5(2015-04-29 07:06:13) Information: Attempt:01

(2015-04-29 07:06:13) Information: Opened the QlikView Engine successfully. ProcessID=34476

(2015-04-29 07:06:13) Information: Allocated QlikView Engine successfully. Current usage count=5 of 21 (of type non-reader). Ticket number=156.

(2015-04-29 07:06:13) Information: Loading document "E:\QVSchedule\UAT\DOC.qvw" (1680.28 Mb)

(2015-04-29 07:06:14) Information: Loading. LoadTime=00:00:01.0140000

(2015-04-29 07:06:16) Information: Loading. LoadTime=00:00:03.0420000

....

.... -> STARTS TO TAKE LOT OF TIME

....

(2015-04-29 07:20:16) Information: Loading. LoadTime=00:00:03.0420000

....

.... -> AND AFTER LOTS OF TIME, FINALLY I GET

....

(2015-04-29 07:39:44) Information: Loading. LoadTime=00:33:30.7620000

(2015-04-29 07:40:11) Information: Physical FileSize=1680.28 Mb. Memory Allocation Delta for this file=6355.66 Mb. Available Physical Memory Before Open=458995.70 Mb. Available Physical Memory After Open=461270.14 Mb. Total Physical Memory=524266.31 Mb.

(2015-04-29 07:40:11) Information: Attempted to load the document with data.

(2015-04-29 07:40:11) Information: The document was loaded successfully.

I have compared the QV scripts of both the fast and the long running file, they are the same.

Do you have a hint what the cause of this long-loading problem could be?

Thx a lot - Marcel

[jpenuliar]

How much size is your source data being loaded?

If you have implemented a single Load from source table, Load time will increase with file size.

[jpenuliar]

If Data loading is the cause of the issue, have a look at :

Types of loads in Qlikview

[hugmarcel]

Initial data load is not the issue. The file size is 1680.28 Mb as you can see in the log extract.

Time consumption gets very high after Initial loading, when the file is loaded again for Distribution. See in the log extract.

Thx - Marcel

[hugmarcel]

If check memory consumption in Windows Task Manager, I see that memory consumption always changes between 6'123'456 MB and 6'090'232 MB when still about to open the file. But I do not know what the cause of this switching could be.

Marcel

[hugmarcel · Accepted solution]

I used my working backup qvw file and have re-implemented all changes step by step. After each step I run the task in QMC and checked that it runs fine. Finally, I end with a working version that runs ok.

I could not find out what has caused the issue.

Marcel