topic Re: Internal Inconsistency in QlikView

Internal Inconsistency

spividori — Mon, 09 Mar 2015 10:18:41 GMT

Hi.

I have a file .qvd. It contains 8.800.000 registers. To recharge my application I add the following:

Autonumber(C_ID&'-'&N_IT&'-'&V) as Key,

Autonumber(C_ID&'-'&N_IT) as Key1,

This generates the following error:

or the following:

Someone can help me solve it?

Regards.

Re: Internal Inconsistency

Gysbert_Wassenaar — Mon, 09 Mar 2015 10:27:25 GMT

Looks like your machine ran out of memory. Look at the ram usage when reloading the document.

Try loading a smaller set of records to see if the document reloads then and also check for the existence of synthetic keys in your data model.

Re: Internal Inconsistency

spividori — Mon, 09 Mar 2015 13:21:05 GMT

Hi Gysbert.

Thanks for responding.

Reloading a small set of records, the error does not appear.

No synthetic key exists.

Regards.

Re: Internal Inconsistency

Gysbert_Wassenaar — Mon, 09 Mar 2015 14:13:20 GMT

Ok, then are you joining tables in the script?

Try monitoring ram usage during reload using the windows Task Manager. How much ram is used? How much is available in your system. Are you using the 32-bit version of Qlikview or the 64-bit version?

Re: Internal Inconsistency

spividori — Tue, 10 Mar 2015 10:57:59 GMT

Hi Gysbert.

Only load the table is in the qvd file containing 8,800,000 records and 20 columns.

The pc that makes recharging has 4GB of memory and 32-bit windows. When the monitor memory usage windows task manager shows 1.8 gb memory used error appears.

Thank You.

Regards.

Re: Internal Inconsistency

Gysbert_Wassenaar — Tue, 10 Mar 2015 11:03:44 GMT

Ok, on a 32-bit system the maximum amount of ram a process can use is 2GB. You could be hitting that limit. Try loading on a 64-bit machine with the 64-bit version of Qlikview. Have you tried loading the qvd file in a new Qlikview document too? Just to make sure that your Qlikview document itself is not corrupt.

Re: Internal Inconsistency

spividori — Tue, 10 Mar 2015 11:17:10 GMT

Yes, I tried to reload a new document and in different pc too, but the error appears. I will try on a machine with 64-bit windows as you advise me. But my server is 32 bits.

Re: Internal Inconsistency

spividori — Tue, 10 Mar 2015 12:13:25 GMT

Hi Gysbert. I made the recharge on a pc with windows 64 bit and no error occurred. The monitor memory usage windows task manager shows 2.8 gb memory used. Regards.

Re: Internal Inconsistency

Gysbert_Wassenaar — Tue, 10 Mar 2015 12:17:17 GMT

Great. Looks like you found the cause then and have a solution.

Re: Internal Inconsistency

spividori — Tue, 10 Mar 2015 13:03:20 GMT

Yes, I'll have to change the windows to my server at 64 bits. I thought it might be another solution. Thank You. Regards.

Re: Internal Inconsistency

spividori — Wed, 11 Mar 2015 12:56:55 GMT

Hi.

I tried to recharging discarding the "AutoNumber" function:
C_ID & "-" & N_IT & "-" & V as Key
C_ID & "-" & N_IT as Key1
There was no error, memory usage reached 1.3 gb.
Can it be that the "autonumber" requires a high memory usage?

Regards.

Re: Internal Inconsistency

Gysbert_Wassenaar — Wed, 11 Mar 2015 13:01:33 GMT

Yes, the autonumber function can need a lot temporary space if the cardinality of C_ID&'-'&N_IT&'-'&V is high and your source data has a lot of records.

Re: Internal Inconsistency

spividori — Wed, 11 Mar 2015 13:11:17 GMT

But it would be more efficient to use the "autonumber" function to the data model.

Is this so?

Regards.

Re: Internal Inconsistency

Gysbert_Wassenaar — Wed, 11 Mar 2015 13:24:47 GMT

Because at the end you will have a qlikview document that is smaller and faster then you would have if you used the bare concatenated key. Calculating the autonumber values requires more ram only during the reload.

Re: Internal Inconsistency

spividori — Wed, 11 Mar 2015 13:29:12 GMT

Ok, thank you very much for the clarification.

Regards.