https://community.qlik.com/t5/App-Development/How-to-calc-table-measures-economically/m-p/1628821#M46791 <P><SPAN>Hi. </SPAN></P><P><SPAN>I am building a system for monitoring data quality.</SPAN><BR /><SPAN>It is building a daily history on all qvds saved in the prod environment. </SPAN><BR /><SPAN>It is getting a lot of the table info from metadata tables.</SPAN><BR /><SPAN>- field counts, unique vakues, row counts.</SPAN><BR /><BR /><SPAN>But I would like some more direct measures as well:</SPAN><BR /><SPAN>- numeric: columns: median , min, max, average, stdev, outliers</SPAN><BR /><SPAN>- for categorical cols: distrbution</SPAN><BR /><BR /><SPAN>The direct measures are a bit on the cpu intensive side, since it is fairly large data.</SPAN><BR /><SPAN>I am thinking to do the calculations when the table is created in order to save resources-to do it twice.</SPAN><BR /><SPAN>What I am doing now is looping over columns and calculating all measures on all columns. It takes it toll on systems.</SPAN><BR /><SPAN>Are there any smarthacks....or any techinal details and manouvers I can do do to make it easier...</SPAN><BR /><BR /><SPAN>BR Lasse</SPAN></P> Sat, 16 Nov 2024 20:00:06 GMT essalj666 2024-11-16T20:00:06Z https://community.qlik.com/t5/App-Development/How-to-calc-table-measures-economically/m-p/1628821#M46791 <P><SPAN>Hi. </SPAN></P><P><SPAN>I am building a system for monitoring data quality.</SPAN><BR /><SPAN>It is building a daily history on all qvds saved in the prod environment. </SPAN><BR /><SPAN>It is getting a lot of the table info from metadata tables.</SPAN><BR /><SPAN>- field counts, unique vakues, row counts.</SPAN><BR /><BR /><SPAN>But I would like some more direct measures as well:</SPAN><BR /><SPAN>- numeric: columns: median , min, max, average, stdev, outliers</SPAN><BR /><SPAN>- for categorical cols: distrbution</SPAN><BR /><BR /><SPAN>The direct measures are a bit on the cpu intensive side, since it is fairly large data.</SPAN><BR /><SPAN>I am thinking to do the calculations when the table is created in order to save resources-to do it twice.</SPAN><BR /><SPAN>What I am doing now is looping over columns and calculating all measures on all columns. It takes it toll on systems.</SPAN><BR /><SPAN>Are there any smarthacks....or any techinal details and manouvers I can do do to make it easier...</SPAN><BR /><BR /><SPAN>BR Lasse</SPAN></P> Sat, 16 Nov 2024 20:00:06 GMT https://community.qlik.com/t5/App-Development/How-to-calc-table-measures-economically/m-p/1628821#M46791 essalj666 2024-11-16T20:00:06Z