Hello Qlik & Qlik-ers ,
Recently I've begun translating functionality of Data Science educational curriculums into QlikView.
Specifically to learn the data science concepts, and additionally to explore the coding possibilities when migrating syntaxes across Qlik, Python, & R. (could Qlik data-science libraries be fashioned and prepackaged, the same way Python does this?)
So far I haven't reached a point where the data science becomes prohibitive in Qlik, there's been no function or calculation yet where I discover 'Qlik does not have that gear' (but I've only explored fundamentals so far).
However, a few things seem evident. Though we have the STERR & STDEV functions, a lot of the data science exercises want to work with the precursor calculation the VARIANCE. VARIANCE is a component used to form the STERR & STDEV , but I haven't seen a convenient VARIANCE() function that calculates this directly.
Do we have a VARIANCE() function, and I just haven't looked in the right place?
Also, it appears statistical functions have more specificity with the advent of Data Science. A solitary STERR or STDEV function is no longer sufficient, because Data Science is obsessed with the idea calculations modify based on whether you are evaluating the entire population, or just a sample.
Therefore, if you're just evaluating a sample, the denominator of ratios get penalized -1 from the count of total items.
(conceptually this seems strange to me, as if we calculate Avg of the entire data set without selections (population?), we wouldn't reduce the denominator of that Avg merely because we applied selections (sample?) and examined only a portion of the data set. For aggregation purposes up till now, regional evaluation is considered just as valid as a global evaluation.)
In Excel, this resulted in the evolution of the statistical functions into two splits, a .P series & an .S series:
STDEV split into STDEV.P (for population), and STDEV.S (for sample), STERR.P , STERR.S, etc..
So do we have a way to parameterize Qlik STDEV & STERR functions so they differentiate between Sample & Population? i.e. STDEV(Salary, P) vs. STDEV(Salary, S)?
Appreciate your time Qlikish Data Scientists, thanks very much! ~E
.png "Former Employee"){kind=icon}
