topic Re: Num function behaviour in QlikView

Num function behaviour

moleroalonso — Mon, 17 Oct 2016 08:37:54 GMT

Hi,

I've applied Num function in this case num(((9.34 + 9.34 + 9.34 + 9.20 )/4),'#.##0,00') and the result is "9.30" but I expected "9.31" because the result of the operation result is "9.305". If I apply Num function to "9.305" the result is the expected, "9.31"

Why do it happens?

Re: Num function behaviour

sunny_talwar — Mon, 17 Oct 2016 16:19:15 GMT

I think you should read about Rounding Errors in QlikView

Re: Num function behaviour

Anonymous — Mon, 17 Oct 2016 16:26:04 GMT

if you moved average calculaton to other variable then passed that variable to num function then it is returning correct result.

let var0 = ((9.34 + 9.34 + 9.34 + 9.20 )/4);

let var1 = num($(var0),'#.##');

let var2= num(9.305,'#.##');

Re: Num function behaviour

moleroalonso — Tue, 18 Oct 2016 09:29:05 GMT

Thank for your answers.

I have applied this solution:

=num(((9.34 + 9.34 + 9.34 + 9.20 )/4) + 0.000001,'#.##0,00')

Add a very little number that forces to rounding