Optimization by changing Metric Precision

[diwakarnahata]

Hi All,

gwassenaar‌jontydkpi‌rwunderlich‌

I am currently working on optimizing an application which holds ~10 GB of uncompressed data.

There is a metric which is heavily used in almost all the expressions.

It has a precision of 6 digits of which the last 3 digits are always 0.

Will it provide any major optimization to reduce the precision to 3 digits?

It is wise to expect better CPU utilization after this change?

Regards,

Diwakar

[Gysbert_Wassenaar]

Is that metric a field or the result of an expression? If you're talking about a field then I don't expect a large difference in performance by reducing the precision.

[rwunderlich]

I don't think it would make a CPU difference.

You may want to check the memory size of the field though. What is the current Symbol Width of the field? If it's not 8, then check the Document Properties, Number Format for the field. If its Mixed, set a numeric type.

-Rob