Problem loading and storing QVD files at the same time

[Anonymous]

Hi all,

I have an QlikView application, let's call it "QVD Generator", that loads a lot of data and finally in the script stores my only fact table into a QVD file. I load it through the QlikView Publisher with a tight schedule that reloads every half hour.

Then i have another application, let's call it "Consumer Application", that loads data from the QVD file in the load script. I load this application through the QlikView Publisher once a day, every morning at 7 am.

To my problem: I have noticed that the load of the "QVD Generator" application fails once a day, at 7 am of course. Other times, no problem. I have generated several log files, and all of them shows that my script fails when trying to STORE the QVD file (that is being loaded from another application).

There must be more that have experienced the same kind of problem, are there any clever solution to this issue? I have searched though blog posts, discussions and topics, without finding this problem. If you know any reading to this topic, please refer to it here...

Thanks for your help.

Best regards,

Filip

[Peter_Cammaert]

Perfect. My suggestion does about the same, although without Job 2.

Good luck,

Peter

[Anonymous]

Thanks for your response Steve!

"What you could do is write your QVDs to a staging filename, and then issue an execute statement in the load script to rename them at the last minute of the generate routine.  This way the amount of time the file is locked due to writing will be minimized."

How do I write this piece of code in the load script?

This sounds like the best solution, for both storing a file without failing the "QVD Generator" load, and to make sure that the data my "Consumer Applications" reads is updated.

[Anonymous]

I just noticed that my idea with the copy of the QVD file with an "external program" task in the scheduler gives me problem.

My "Consumer Applications" only loads a part from the QVD file that data is being copied to. I've noticed that the running time of the external program takes very long time... about one and a half minute, but when I run the BAT file from Windows, it copies within just a second. Can any of you guys explain that, or should I make a new thread on this topic?

This is from the task log in QV Publisher:

(2015-05-05 13:33:09) Information: Starting task 'Kopia av Resultatrader.qvd'. Id:a39c9418-b447-4a2c-b317-aff0166c695a. Triggered by 'TaskCompletedTrigger'. Id:79db2c50-871d-4c01-9574-5e3a72b2d4ec

(2015-05-05 13:33:09) Information: Entering Task Execution.

(2015-05-05 13:33:09) Information: ClusterID=1

(2015-05-05 13:33:09) Information: QDSID=485e0c73-f39d-970c-7470-34d4abd27f1e

(2015-05-05 13:33:09) Information: TaskID=a39c9418-b447-4a2c-b317-aff0166c695a

(2015-05-05 13:33:09) Information: MaxRunTime=1.00:00:00

(2015-05-05 13:33:09) Information: MachineName=SATSQLKDKHOS003

(2015-05-05 13:33:09) Information: Max attempts:1

(2015-05-05 13:33:09) Information: Current Attempt=0

(2015-05-05 13:33:09) Information: Task Dependencies are OK

(2015-05-05 13:33:09) Information: Executing "D:\QlikView Storage\Private Data\Cmd Files\Kopia av Resultatrader.qvd.bat

(2015-05-05 13:33:09) Information: Executing commandline: "D:\QlikView Storage\Private Data\Cmd Files\Kopia av Resultatrader.qvd.bat" in folder "D:\QlikView Storage\Private Data\Cmd Files".

(2015-05-05 13:34:36) Information: The process exited with ExitCode zero (OK) at 2015-05-05 13:34:36

(2015-05-05 13:34:36) Information: Task Execute Duration=00:01:26.5025545

(2015-05-05 13:34:36) Information: The task "Kopia av Resultatrader.qvd" finished successfully

(2015-05-05 13:34:36) Information: TaskResult.status=Finished

(2015-05-05 13:34:36) Information: Notifying all triggers of new state:Finished

(2015-05-05 13:34:36) Information: Notifying all triggers of new state:Finished - completed

(2015-05-05 13:34:36) Information: Saving Task Result