topic Re: Different from 0 in set analysis in App Development

Different from 0 in set analysis

maxim1500 — Wed, 14 Dec 2016 16:50:28 GMT

Hi,

I am trying to count the number of ids from a fact table where the quantity or total value is different from 0 . Both fields are in the fact table. The following query works fine:

Count({<$(=vSelectedDate), [Position Total Value] = {'<0'}+{'>0'}>+<$(=vSelectedDate), [Position Quantity] = {'<0'}+{'>0'}>}distinct [Security ID])

I was wondering if there were better ways to do this. For example, I tried to merge {'<0'}+{'>0'} into a single condition, such as:

Count({<$(=vSelectedDate), [Position Total Value] -= {'0'}>+<$(=vSelectedDate), [Position Quantity] -= {'0'}>}distinct [Security ID])

But the result is wrong. As a matter of fact, the following query returns 0, and there are >100.

Count({<$(=vSelectedDate), [Position Quantity] = {'0'}>}distinct [Security ID]).

Any idea how to do better? We have some performance issues, and we hope to improve that by simplifying set analysis as much as possible.

Thanks!

Re: Different from 0 in set analysis

sunny_talwar — Wed, 14 Dec 2016 17:05:19 GMT

Try intersection of negatives instead of union:

Count({<$(=vSelectedDate), [Position Total Value] -= {'0'}, [Position Quantity] -= {'0'}>}distinct [Security ID])

Re: Different from 0 in set analysis

maxim1500 — Wed, 14 Dec 2016 17:07:54 GMT

Thanks Sunny,

For some reason, [Position Quantity] = {'0'} does not work. Data is numeric and in the fact table. This is not a dimension. I tried removing the comas, adding =0 with or without comas, doesn't work. I checked manually in the dataset, and there are values at 0.00000000 as a quantity.

Re: Different from 0 in set analysis

vinieme12 — Wed, 14 Dec 2016 17:11:55 GMT

then try greater than 0

Count({<$(=vSelectedDate), [Position Total Value] = {'>0'}, [Position Quantity] = {'>0'}>}distinct [Security ID])

Re: Different from 0 in set analysis

maxim1500 — Wed, 14 Dec 2016 17:13:02 GMT

Quantity could be negative. That's why I used {'<0'}+{'>0'}

Re: Different from 0 in set analysis

sunny_talwar — Wed, 14 Dec 2016 17:14:21 GMT

Are you trying to include of exclude 0?

[Position Quantity] -= {'0'} or [Position Quantity] = {'0'}

Re: Different from 0 in set analysis

maxim1500 — Wed, 14 Dec 2016 17:16:30 GMT

I want to exclude it. But both of them do not work. If I exclude, it returns the full dataset. If I include, it returns 0.

Re: Different from 0 in set analysis

sunny_talwar — Wed, 14 Dec 2016 17:17:56 GMT

How about this?

[Position Quantity] = {"=Num([Position Quantity]) <> 0"}

Re: Different from 0 in set analysis

maxim1500 — Wed, 14 Dec 2016 17:22:46 GMT

Yeah that works. I guess there is something wrong with format in my table. Thanks!

The idea of [Position Total Value] -= {'0'}, [Position Quantity] -= {'0'} won't work though. I need to exclude entries that have both total value and quantity = 0 at the same time. If you have one or the other, it needs to stay.

Re: Different from 0 in set analysis

sunny_talwar — Wed, 14 Dec 2016 17:25:54 GMT

Got it, then back may be like this:

Count({<$(=vSelectedDate), [Security ID] = {"=[Position Total Value] <> 0 and Num([Position Quantity]) <> 0"}>} DISTINCT [Security ID])

Pick Security ID where both Value and Quantity are not equal to 0

Re: Different from 0 in set analysis

maxim1500 — Wed, 14 Dec 2016 17:35:16 GMT

Don't know why, but numbers are off... Looks logical though...

Re: Different from 0 in set analysis

sunny_talwar — Wed, 14 Dec 2016 17:37:05 GMT

May be you have more than one value and/or quantity for each security id?

Count({<$(=vSelectedDate), [Security ID] = {"=Sum([Position Total Value]) <> 0 and Sum([Position Quantity]) <> 0"}>} DISTINCT [Security ID])

Re: Different from 0 in set analysis

maxim1500 — Wed, 14 Dec 2016 18:15:30 GMT

Sadly, it doesn't solve the issue...

In fact, it should be

Count({<$(=vSelectedDate), [Security ID] = {"=Sum([Position Total Value]) <> 0 OR Sum([Position Quantity]) <> 0"}>} DISTINCT [Security ID])

since I want securities that have one of the conditions true. But still wrong...

Re: Different from 0 in set analysis

maxim1500 — Wed, 14 Dec 2016 18:17:10 GMT

Even this :

Count({<$(=vSelectedDate), [Security ID] = {"=Num([Position Quantity]) <> 0"}>} DISTINCT [Security ID])

doesn't give the right number, if I consider only the quantity part. Sum and Num gives the same result.

Re: Different from 0 in set analysis

sunny_talwar — Wed, 14 Dec 2016 23:18:22 GMT

Its difficult to see what might be causing this, would you be able to share your application to take a quick look at it?

Re: Different from 0 in set analysis

maxim1500 — Thu, 15 Dec 2016 12:48:02 GMT

Thanks for your help Sunny, but I cannot publish the app for security reasons, even without data.

Re: Different from 0 in set analysis

swuehl — Thu, 15 Dec 2016 13:03:58 GMT

Maybe you need to use your date filter also in the advanced search:

Count({<$(=vSelectedDate), [Security ID] = {"=Only({<$(=vSelectedDate)>} [Position Quantity]) <> 0"}>} DISTINCT [Security ID])

(maybe you don't need the first part then:

Count({< [Security ID] = {"=Only({<$(=vSelectedDate)>} [Position Quantity]) <> 0"}>} DISTINCT [Security ID])

Not sure if your dollar sign expansion is correct, that's hard to tell with the few information provided.

Re: Different from 0 in set analysis

maxim1500 — Thu, 15 Dec 2016 13:11:57 GMT

That's right! Thanks for your help guys!

The only little correction needed is to replace the " by ', and it works fine. Here is the working solution:

Count({<[Security ID] = {'=Only({<$(=vSelectedDate)>} [Position Quantity]) <> 0 or Only({<$(=vSelectedDate)>} [Position Total Value]) <> 0'}>} DISTINCT [Security ID])

I am wondering though, is it faster to use this with two only or use something like this:

Count({<$(=vSelectedDate), [Position Total Value] -= {'0'}>+<$(=vSelectedDate), [Position Quantity] -= {'0'}>}distinct [Security ID])

Re: Different from 0 in set analysis

sunny_talwar — Thu, 15 Dec 2016 13:14:25 GMT

Wow!! We were so close and yet so far away.....Thanks to Stefan for taking us all the way.

Best,

Sunny

Re: Different from 0 in set analysis

swuehl — Thu, 15 Dec 2016 13:16:15 GMT

I am wondering though, is it faster to use this with two only or use something like this:

You'll need to test this with your real data, I think (but wasn't there a problem with filtering on zero?).