topic Re: Cannot Open file when tying to Store to a QVD in App Development

Cannot Open file when tying to Store to a QVD

toddprete — Mon, 01 May 2017 14:17:36 GMT

Hello,

I have an existing qlik sense app that runs once a month, that sometimes fails when trying to store the data to the QVD. Now the QVD is locked. The process is trying to store @ 11 million records. I have many other scripts that run successful but are much smaller in size. I've pasted part of the log below.

2017-05-01 09:33:10 0182 STORE MAC_TABLE INTO S:\Data Files\QVDFiles\RACE\GDW\MONTHLY_ACTIVE_CONTRACT_QVD.QVD

2017-05-01 09:33:20 Error: Cannot open file: 'S:\Data Files\QVDFiles\RACE\GDW\MONTHLY_ACTIVE_CONTRACT_QVD.QVD'

2017-05-01 09:33:20 Execution Failed

2017-05-01 09:33:20 Execution finished.

Re: Cannot Open file when tying to Store to a QVD

Anonymous — Mon, 01 May 2017 14:48:29 GMT

Try putting a sleep(9000) after the Store command.

I have found that when storing large qvd's the script often needs a pause to ensure everything is truly flushed from cache to disc before continuing.

Re: Cannot Open file when tying to Store to a QVD

toddprete — Mon, 01 May 2017 14:53:41 GMT

Bill, should I put the sleep before or after the store. The error indicates the app failed on the Store and thus would not get to the sleep if I put it after the store.

Re: Cannot Open file when tying to Store to a QVD

Anonymous — Mon, 01 May 2017 15:24:17 GMT

After the Store. I know it sounds a bit counter intuitive, but it has often worked for me.

Re: Cannot Open file when tying to Store to a QVD

toddprete — Tue, 02 May 2017 13:29:50 GMT

Bill,

I'm still trying to test your solution, but I can't seem to unlock the QVD that became locked when the issue occurred. I did have my IT group restart the QLIK Sense services, but that did not unlock the QVD. Any suggestions on how to unlock a QVD

Re: Cannot Open file when tying to Store to a QVD

Anonymous — Tue, 02 May 2017 14:00:44 GMT

Sometimes when thing crash out / get terminated untidily then you can get left with zombie processes that are not actually still doing anything per se, but can still have active residual locks.

First I would close all the Qlik windows on your session and look for / kill any residual Qlik processes.

If no joy with that then look for any potential zombies from any other users.

If still no joy then restart the server where the QVD file resides.

Re: Cannot Open file when tying to Store to a QVD

toddprete — Tue, 02 May 2017 14:12:13 GMT

I'm a little concerned about closing any residual qlik processes and/or zombies, as I don't want to kill something that is actually needed. any hints to what a zombie looks like?

Also, are you saying that simply restarted the service will not kill the lock, instead I need to restart the server?

Re: Cannot Open file when tying to Store to a QVD

Anonymous — Tue, 02 May 2017 14:20:02 GMT

It depends what created the lock. You could first try restarting the Services.

Re: Cannot Open file when tying to Store to a QVD

toddprete — Tue, 02 May 2017 14:22:44 GMT

I've restarted the services twice. Is there more than one service I need to restart. Maybe, I'm not starting the correct service. What exactly is the name(s) of the qlik sense services I need to restart? Bill, I really appreciating you help with this issue. thank you very much

Re: Cannot Open file when tying to Store to a QVD

Anonymous — Tue, 02 May 2017 14:37:46 GMT

Then the blunt way is to restart the server where the QVD file resides,

Re: Cannot Open file when tying to Store to a QVD

toddprete — Tue, 02 May 2017 17:23:48 GMT

Bill,

The restarting of the server (not service) successfully unlocked the QVD. I also added the sleep after the STORE command, reloaded the app, and the QVD was successfully reloaded.

Thanks for your help.

Re: Cannot Open file when tying to Store to a QVD

federerman — Mon, 18 Mar 2019 14:02:25 GMT

We experienced a similar issue with QVD locking when performing an incremental load. In short, we read the QVD from disk and append new/updated records, then store it back to disk overwriting the old QVD.

Occasionally, the STORE command would fail (maybe once a week) with error messages suggesting QVD locking.

Thinking it was likely a latency issue where the lock wasn't being released after the initial read, we tried adding a 10s sleep BEFORE the store command. This did not resolve the issue. After finding this thread, we added a 10s sleep AFTER the store command and the issue seems to be resolved. We are going on 2 weeks without a task failure.

While counter intuitive, this solution seems to work. Thank you very much for posting!

P.S. Would be nice if the store command had this feature built in, or just worked, rather than having to use this work around.

Re: Cannot Open file when tying to Store to a QVD

Eve182 — Mon, 19 Aug 2019 08:14:48 GMT

I've been seeing the same issue for years now. But sometimes the fail would be only once a month. so it was not that urgent for me. But I am giving this sleep suggestion a try and I hope this solves the problem.

Thanks.