topic Number format in QlikView

Number format

rajni_batra — Wed, 05 Dec 2012 14:55:08 GMT

i have a number coming in format

2.0161002947175e+014 which is equal to 201,610,029,471,749 actually but in my script if i use

num(num#(FBK_BKINGID

),'###############0') it gives me output 201610029471750 which is 1 greater than above whts wrong

Re: Number format

m_woolf — Wed, 05 Dec 2012 14:59:28 GMT

2.0161002947175e+014

means

2.0161002947175 X 10^14

which is

201,610,029,471,750

Re: Number format

hic — Wed, 05 Dec 2012 19:15:12 GMT

The IEEE double-precision binary floating-point format is 53 bits, which corresponds to 14 decimal digits.

In other words, QlikView can only use the first 14 digits. The rest of the mantissa will be discarded. In your case it means that somewhere a rounding converts the last digits from ...1749 to ...1750.

HIC

Re: Number format

rajni_batra — Thu, 06 Dec 2012 04:58:55 GMT

hello mwoolf ,

but when i use number format in list box n choose inter it gives 201,610,029,471,749 only which i need actually ..

Henric,

now what should i do?? becoz this is the primary ke n affecting my results