topic Re: Floor function different result in App Development

Floor function different result

geertdeman — Sat, 16 Nov 2024 18:12:31 GMT

can someone explain why floor(95/100,0.001) returns 95.0% and floor(57/60,0.001) teturns 94.9% (format pattern for both is #,##0.0%) in a pivot table in qlik sense . I would expect that both would return 95.0%

Re: Floor function different result

tresB — Thu, 20 Aug 2020 10:33:49 GMT

This is because of binary representation precision issue with floating point numbers. For better understanding, read this blog : https://community.qlik.com/t5/Qlik-Design-Blog/Rounding-Errors/ba-p/1468808

Re: Floor function different result

geertdeman — Wed, 23 Sep 2020 08:57:26 GMT

can someone provide me an answer how I can solve this?

Re: Floor function different result

swuehl — Wed, 23 Sep 2020 09:58:52 GMT

As Henric mentioned in the blog post, you can use integers for all calculations, and only return to sub integers for display purposes at the very last step.

In your case, multiply both calculations with factor 1000.