topic Re: General Script Error issue in QlikView

General Script Error issue

cjzimm76 — Fri, 20 Jun 2014 17:21:51 GMT

I have a .qvw file and its only purpose is the generate multiple .qvd files. The task will run on the server successfully for weeks at a time, and then unexpectedly, I get the "General Script Error Execution Failed". message in the middle of the task. All of the .qvds are creating from the same data source and stored in the same folder. After some time passes, I can run the task again without making any changes to the .qvw script and it will run successfully. There is plenty of disk space available. Folder permissions should not be an issue as the task will create the first couple .qvds but then the error comes in the middle of the script. Any ideas on how to solve or trouble shoot this would be appreciated.

Re: General Script Error issue

swuehl — Fri, 20 Jun 2014 17:24:08 GMT

Could there be a conflict with another qvw accessing the same set of qvw for reading (so they are locked when your qvw tries writing to them)?

Re: General Script Error issue

cjzimm76 — Fri, 20 Jun 2014 17:25:50 GMT

All other QV tasks are dependent on this task to being completed first.

Re: General Script Error issue

swuehl — Fri, 20 Jun 2014 17:39:20 GMT

No manual reloads happening? No backup / 3rd party software reading the qvds in the time you are running your script?

Could you upload the document log and task log?

Re: General Script Error issue

cjzimm76 — Fri, 20 Jun 2014 17:41:29 GMT

(2014-06-20 10:57:27) Information: Reloading.........

(2014-06-20 11:12:27) Information: Reloading..........

(2014-06-20 11:14:58) Information: The Source Document reload complete. DocumentPath=C:\ProgramData\QlikTech\Documents\QVD Generator.qvw

(2014-06-20 11:14:58) Information: Memory Allocation Delta for this file=83.30 Mb. Available Physical Memory Before Reload=38274.49 Mb. Available Physical Memory After Reload=37746.13 Mb. Total Physical Memory=37746.13 Mb.

(2014-06-20 11:14:58) Error: The Source Document was NOT reloaded successfully. DocumentPath=C:\ProgramData\QlikTech\Documents\QVD Generator.qvw.

(2014-06-20 11:14:58) Information: Initializing Reload (0), Finished (19854297)

(2014-06-20 11:14:58) Error: Reload failed.

(2014-06-20 11:14:58) Information: Closing the document.

(2014-06-20 11:14:59) Information: Closed the QlikView Engine successfully. ProcessID=5996

(2014-06-20 11:14:59) Information: Initializing (0), Finished (265)

(2014-06-20 11:14:59) Error: Reload failed. Distribution skipped.

(2014-06-20 11:14:59) Error: The task "QVD Generator.qvw" failed. ErrorCount=3

Re: General Script Error issue

cjzimm76 — Fri, 20 Jun 2014 17:43:45 GMT

6/20/2014 11:11:51 AM: 0426 FROM DBO."T_TRANS"

6/20/2014 11:11:51 AM: 3 fields found: TSTAMP, TX_AGG_ACCTVAL, TX_AGG_CONTRIB_AMT 233,681 lines fetched

6/20/2014 11:14:55 AM: 0428 Store [LIT Transactions] into QVD\LIT Transactions.QVD

6/20/2014 11:14:58 AM: General Script Error

6/20/2014 11:14:58 AM: Execution Failed

6/20/2014 11:14:58 AM: Execution finished.

Re: General Script Error issue

Chris_Rice — Fri, 20 Jun 2014 18:39:32 GMT

Looks like it's failing on the STORE command, so my best guess is that something is blocking the write process. I've seen that happen with anti-virus scanners locking the files, as well as latency in reading/writing with a NAS. If you are using some type of NAS I would put the files on a local drive to see if the issue persists. Should the issue persist, you could use a program like Process Explorer to see what other programs may be locking that file.

Re: General Script Error issue

Fri, 20 Jun 2014 19:04:54 GMT

Hi,

Try to find which file is giving error, as per my understanding you are creating a number of qvd's from the source, so just try to identify which qvd is making error and put that alone in a separate application and check for detailed error description.

So you can get some more idea about the error to rectify.

Re: General Script Error issue

cjzimm76 — Fri, 20 Jun 2014 19:23:37 GMT

We are using a local drive. I'll see if Process Explorer can be used during our reload times.

Re: General Script Error issue

cjzimm76 — Fri, 20 Jun 2014 19:24:41 GMT

Kira,

It can be a different qvd each time. And like I said, I just wait and run the same code a little later and it will work fine.

Re: General Script Error issue

Fri, 20 Jun 2014 19:34:59 GMT

Then it could be a ram issue;

Try to do a partial reload and check if it executes fine with out any error

hope it helps!

Re: General Script Error issue

VishalWaghole — Sat, 21 Jun 2014 06:59:06 GMT

Hi Charlie,

If this error is coming with server auto reload, then please try it by manual reload.

I don't know you purpose to create multiple Qvd's using single Qvw.

If possible then please try to use single Qvw for single Qvd,

by doing this you will diagnose where the actual problem was occurred.

Hope you understand...

--Thanks and Regards,

Vishal Waghole.

Re: General Script Error issue

cjzimm76 — Tue, 24 Jun 2014 14:39:39 GMT

Its a different .qvd each time. The code never changes. Most of the times it runs as it should. Just once or twice a month It will stop at one of the Store statements.

Re: Re: General Script Error issue

swuehl — Tue, 24 Jun 2014 19:19:41 GMT

Hi Charlie,

I think I am not the only one who assumes that some process is occasionally blocking the write access to your QVDs.

I would start looking at the usual suspects, anti-virus, backup tools etc.

Brainstroming 5 minutes with your system admin (or reading the server docs...) may reveal some processes that may lock your files.

Or have a look at Microsoft's Process Monitor

http://technet.microsoft.com/en-us/sysinternals/bb896645.aspx

And here is a short introduction how you can make use of it:

http://answers.perforce.com/articles/KB_Article/Using-Process-Monitor-to-Monitor-File-Access

Re: General Script Error issue

Fri, 03 Oct 2014 13:20:46 GMT

Hi Charlie,

I have same problem which you have when I try generate QVD files.

You solve your problem? How?

Thanks.

Re: General Script Error issue

jeremy_fourman — Fri, 03 Oct 2014 14:56:37 GMT

A big contributor to this is when a QVD is being created and another QVW is trying to read it or vice-versa, as others have mentioned it is a read/write lock on a file. This can usually be sorted out by dependency chaining tasks properly within the QMC.

Re: General Script Error issue

Anonymous — Sat, 04 Oct 2014 13:20:46 GMT

I have come across this before.

I sorted it by putting a sleep(5000) after every STORE command to make it pause for 5 seconds to give some time for everything to be fully flushed to disc before continuing.

Re: General Script Error issue

roger_stone — Sat, 04 Oct 2014 14:54:49 GMT

This can happen if you have several unrelated batch streams running concurrently. Are there any other non-dependent jobs running at the same time?

Re: General Script Error issue

mvivanco — Sat, 04 Oct 2014 18:29:19 GMT

I had a similar case. My source file was unique, but the data were updated periodically. The problem presented when reading and writing the file coincided. I solved creating "Active source file" and "Inactive source File" that were switched periodically. All updates of the data I did in the "Inactive source File", and my .qwv read the "Active source file".

I hope to expand the idea of the solution

Re: General Script Error issue

jeremy_fourman — Mon, 06 Oct 2014 13:29:20 GMT

Good call on this too, I have done the same. We have used Supporting Tasks in the QMC, the task just reloads a QVW that has nothing in it more than a sleep(x) call. All tasks (within reason) that create a QVD would have chained to them this supporting task. Allows us to tune the sleep time if needed from a single place.