topic QlikView 12 not loading all rows in QlikView

QlikView 12 not loading all rows

Wed, 25 Nov 2020 16:16:04 GMT

I connected QlikView 12 to a postgres database and then used the select tool within the script editor in order to load the information.

Whilst the database has 76,663,082 records, QlikView shows the following message on the Script Execution Progress window: 24,234,281 Lines fetched.

I have tried editing the script to avoid synthetic tables and also the native script to avoid any mistake on my part.

I used this tutorial to connect QlikView to the database.

Thanks in advance,

JC.

Re: QlikView 12 not loading all rows

Gysbert_Wassenaar — Tue, 25 Oct 2016 09:25:16 GMT

Does your machine have enough ram to load all 76 million records into memory?

Re: QlikView 12 not loading all rows

Tue, 25 Oct 2016 14:15:19 GMT

My machine has 64 GB of RAM, do you think that's the problem? Let me try on another machine with more RAM and I'll come back you

Re: QlikView 12 not loading all rows

Fri, 28 Oct 2016 14:05:25 GMT

That was the solution. When I monitored the behavior of the server I found out that it used up to 95 GB of RAM while executing the script. Thanks for sugesting it.

However that should be something that can be handled by SWAP (pagefile.sys) and RAM, shouldn't it?

Re: QlikView 12 not loading all rows

Gysbert_Wassenaar — Sat, 29 Oct 2016 06:42:41 GMT

The swap file is about 1000 times slower than ram. In effect it will seem like the machine is hanging. It isn't, it just became 1000 times slower.