topic num(num#(Value)) returns incorrect results for certain Value range in Archived Groups

num(num#(Value)) returns incorrect results for certain Value range

swuehl — Wed, 23 Jul 2025 14:48:52 GMT

A strange behaviour in combining num with num# function for certain numerical values was observed here:

Reproduced with QV 10.00.9061.7 SR3

See attached sample.

num(num#(Value)) fails to return correct results for values in the range pow(2,31) and pow(2, 33).

s_uhlig — Tue, 27 Sep 2011 08:44:24 GMT

Hi,

really strange - to get more confused, try num(num#(column(1),'#')), which works over the whole range on QV9, but gives up at 2^47 on QV10 !???

BTW, 1e300/-1e300 are singular values too.

Thanks for sharing

Sven

PS.: try to format column(1) as number

swuehl — Sat, 04 Jul 2015 10:49:03 GMT

Just stumbled upon this old thread.

Seems not to be present in QV11.20 SR11 anymore.