Frac() function and number of precision numbers

[#1]

Hello,

I was testing optimization by cut big number in two numbers with less values when an error occur.

Memory didn't decrease as I thought but increased because of Frac() function.

Frac() function returns more precision numbers than the reference field.

Here is my script :

TEST_TEMP:

Load

          round(100*rand(),0.01) as val

autogenerate 100000;

TEST:

LOAD  val,

          floor(val) as floor,

          Frac(val) as frac

resident TEST_TEMP;

drop table TEST_TEMP;

And here is the result :

I had test on QV 11.2012018.0 SR3  and 11.2012018.0 SR5.

So I've to do this :  round(Frac(val),0.01)

Has someone have the same result in others Qv versions ?

Bye,

[#2 · Accepted solution]

I think it's not a bug :

http://community.qlik.com/blogs/qlikviewdesignblog/2013/12/17/rounding-errors