QVD Load bug

[gerhardl]

Hi,

I load hundreds of text files containing transactions into QlikView and then store them into a QVD. I've been doing this for 2 years with no problems  - currently it contains roughly 50 million transactions.

The loading of the text files and storing into the QVD works fine, and this is done once a week.

Every morning a daily Transaction QlikView module is updated which loads all the QVD data in addition to the last few days' transaction text files (those that have not yet been stored into the QVD).

Since early this week I've been having problems with the loading from the QVD - it loads up until about 46 million transactions and then the load script freezes and the entire computer freezes - I can't even move the mouse cursor. I've waited for up to an hour and then I force kill the PC.

I thought this might be one "buggy" record in the QVD, but although it happens at more or less the same line, it's not the exact same line.

It failed earlier on line 46,923,776 and when I just tried it failed on line 46,858,240.

Does anyone know what could cause this?

regards,

Gerhard

[Gysbert_Wassenaar]

That sounds like your machine is running out of ram and starts using the pagefile. Try on a machine with more ram. Maybe it's possible to optimise your load script. You'll have to post that if you want us to look into that.

[gerhardl]

I'm pretty sure you are right - thanks. I can see the memory usage is at 97% just before the freeze.

I'm going to place an order for a new PC with more memory (wanted to do this anyway) and will report back once I've confirmed everything is okay (due to QlikView licensing and the volume of files this will be a huge task to simply test on another PC).