Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

How to increase accuracy in calculation

Hi

How can I increase accuracy (Not just change the format using NUM())when calculating in reload?

For example, when I calculate 26/249, I want 0.1044176707.

If I use NUM() to increase the decimal points, it would just give me 0.10400000000

Thank you very much.

PC

7 Replies
varunjain
Creator
Creator

TRY

num(columnName,'###0.0000000000') this will show you calculation till 10 decimal points.

varunjain
Creator
Creator

Try this in TEXT box... you ll get your result

=num(26/249,'###0.0000000000')

Not applicable
Author

Hi Varun:

I should have mentioned earlier that the calculation is in the reload and the '26' and '249' is a result of a APPLYMAP.

Thank you.

PC

amit_saini
Master III
Master III

Baikand,

Better you check number tab of chart , you can set here the format as per your requirement.

Thanks,

AS

amit_saini
Master III
Master III

Also in expression side try something like below:

=Num(sum(ABC)/sum(XYZ),'####0.0000000000')

Thanks,

AS

varunjain
Creator
Creator

You can use the mentioned parameter in the backend as well.

jagan
Luminary Alumni
Luminary Alumni

Hi,

Try like this

LOAD

*,

num(Applymap('Table1', SomeValue))/num(Applymap('Table2', SomeValue2)) AS Newfield

FROM DataSource;

=num(26)/num(249)


Hope this helps you.


Regards,

jagan.