General Script Error

[shayraber]

hi,

have a document which reloads 3 times a day.

most of the time with no errors at all.

sometimes, recently becomes more often, the script fails. at the same exact point (!!!)

no other document runs in parallel, so it's not an QVD issue.

the point which fails is at grouping by of a 33 million records table.

I see nothing special at the RAM usage.

what could be the reason?

thanks,

Shay

[shayraber]

hi Marcus,

I've tried to check out the server usage model (for the RAM) and didn't see anything weird.

regarding the incremental load - it's not an extract process, but part of the data preparation process.

how can you do that group by in few separated parts?

Shay

[Peter_Cammaert]

A Virus scanner intervening once in a while at unexpected moments?

[marcus_sommer]

For an incremental load-approach it's not essential what kind of loading it is and if any transformations happens - important is only if the same records will be loaded again and again.

Whereby if I look on the answers from the others it seems that you had really rather an issue with the storing-command because that there is any conflicting between Qlik, the OS and maybe some other scanner. In single cases it's often helpful to restart the system but if it happens more often you need some workaround.

The from Bill mentioned sleep-statement might be helpful for this - especially if it's embedded within a small sub-routine which checked if the file is stored and if not do it again - I saw recently here such posting but couldn't find it at the moment. Therefore I'm nout sure if this included the use of ERRORMODE or not. But here you could find something to them and further approaches: Avoid General Script Error in STORE command.

- Marcus

[puttemans]

I experience this also from time to time with some applications, and I can guarantee you it is not the script that contains an error. There have been 2 situations that would trigger this:

Option 1: from time to time, your server gets too much work, and if you are running this script at that particular time on it, it will stop working and give an error

Option 2: there is no space left anymore to write away the generated file. This will trigger the same behaviour

Regards,

Johan

[shayraber]

Hi Marcus/Bill M.

Ill give it a try....

ill try to put some sleep before saving the QVD

Shay