topic Re: Problem with Decimal Precision in QlikView

Problem with Decimal Precision

Fri, 14 Aug 2015 07:26:40 GMT

Hi,

I have a question. I have a straight table with one dimension (week). i want to show total quantity, so i write the expression with sum syntax. But the total value has different decimal precision with the data itself (3 digit precision).

this is my table.

each data has 3 digit decimal, but the sum(quantity) has many decimal.

Really appreciate your help.

Thanks

Re: Problem with Decimal Precision

maxgro — Fri, 14 Aug 2015 07:30:16 GMT

for the sum(....) expression

choose a number format in number tab

Re: Problem with Decimal Precision

sunny_talwar — Fri, 14 Aug 2015 07:32:06 GMT

Are you asking why is this happening? or looking for a solution for this??

Possible solution -> Num(Sum(QUANTITY_RETUR), '#.###')

Re: Problem with Decimal Precision

parthakk — Fri, 14 Aug 2015 07:32:13 GMT

try explicitly setting number of decimal to expression.. it shall reflect in your total value as well

Re: Problem with Decimal Precision

Fri, 14 Aug 2015 07:32:50 GMT

Hi Massimo,

I dont want to change the number format. I am using expression default for number format. Decimal number must be the same with each data.

Do you know why ?

thanks

Re: Problem with Decimal Precision

Fri, 14 Aug 2015 07:39:48 GMT

Hi,

If there any value having the more decimal precision, then it will reflect in total. Use explicit number format for field.

Re: Problem with Decimal Precision

maxgro — Fri, 14 Aug 2015 07:40:42 GMT

if you use expression default (left) you get different number of decimal

if you use a fixed format (right) in number tabb or you format the expression (num(sum(field), '#.##0,00') you get the same number of decimal for all values

or I'm missing something?

Re: Problem with Decimal Precision

Fri, 14 Aug 2015 07:59:48 GMT

Hi Massimo,

Yes, your left image your data is 12 decimal. but my data for each header and line have 3 decimal. So it must be the sum/total is 3 decimal also.

Thanks for your reply Massimo.

Re: Problem with Decimal Precision

Fri, 14 Aug 2015 08:05:23 GMT

Can you post your sample data or how are calculating your quality field values?

Re: Problem with Decimal Precision

Fri, 14 Aug 2015 08:16:37 GMT

Hi Sindhu,

Sorry i cant Sindu. I only use sum(quantity) for the expression. and add three dimension (week, header_id, and line_id).

Data for each header and line is OK with 3 decimal, but the total is more than 3 decimal. Really confuse about it.

Thanks.

Re: Problem with Decimal Precision

sasiparupudi1 — Fri, 14 Aug 2015 09:45:05 GMT

Why cant you use the expression as suggested by Sunny T ?

num(sum(QUANTITY_RETUR),'#.##')

Re: Problem with Decimal Precision

swuehl — Fri, 14 Aug 2015 09:52:19 GMT

Well, you think, that each value has no more than 3 decimal places, and the sum therefore shouldn't show more, but you only see a decimal view of internal binary representation:

Rounding Errors

If you want to show no more than 3 decimal places, use a formatting function (e.g. in the expression, then you can use expression default).