topic Re: What is New Row Applicator ? in QlikView

What is New Row Applicator ?

fredericvillemi — Mon, 12 Jan 2015 14:48:08 GMT

Hello,

i have just installed 11.2SR9 on our production server and in the logs we can now see optimization tips like this one :

Warning

SE_LOG: when AAALR(6.186927) is greater than 1.000000, we suggest using new row applicator to improve time and mem effeciency.

What does it mean ? what is this new row applicator ?

Thanks

Re: What is New Row Applicator ?

marcus_sommer — Mon, 12 Jan 2015 19:53:53 GMT

I don't know but I assume that one/some field(s) have more than 1000000 distinct values or means something similar. Best would be you have a look on your datamodel - per tableviewer and structur-table (it exists already - see new create new objects) - and if try to reconsider the datamodel:

The Importance Of Being Distinct

- Marcus

Re: What is New Row Applicator ?

fredericvillemi — Tue, 13 Jan 2015 07:55:27 GMT

Well, i thought it was the good answer but i have checked this field as soon as i have seen this message and it was mentionning a key column with 7 distinct values. But as it is a key maybe i uses all tables using this key to make this warning.

I will make a ticket to Qlik to try and have an answer about how this warning should be handled

Thanks

Re: What is New Row Applicator ?

jerrysvensson — Tue, 27 Jan 2015 15:08:50 GMT

My log says:

Warning SE_LOG: when AAALR(14.133000) is greater than 1.000000, we suggest using new row applicator to improve time and mem effeciency.

Even worse I guess. 🙂

Have you heard anything from Qlik?

Re: What is New Row Applicator ?

fredericvillemi — Wed, 28 Jan 2015 10:31:49 GMT

I still have not created an example file sorry, i'll try to tell it here when it's done and i have an answer

Re: What is New Row Applicator ?

Anonymous — Wed, 11 Feb 2015 10:10:35 GMT

I just ask Qlik Support the same question, but they couldn't really give any detailed answer. That's what I got back:

"The entry "SE_LOG: when AAALR(1614907703) is greater than 1.000000, we suggest using new row applicator to improve time and mem efficiency. " gives a suggestion that the document that this refers to could be optimized to get better performance. "

There is no specific detail in this. Sorry.

Re: What is New Row Applicator ?

Emmanuelle__Bustos — Mon, 13 Apr 2015 23:18:32 GMT

Same for me in a QVS 11.2 SR10:

Warning SE_LOG: when AAALR(2.922000) is greater than 1.000000, we suggest using new row applicator to improve time and mem effeciency.

Information SE_LOG: aggregation on 'Tramites'(llaveservidor), dstCardinal(3) and AAALR(2.680000).

Any advice?

Re: What is New Row Applicator ?

mongolu — Wed, 14 Oct 2015 17:00:32 GMT

QVS 11.2SR11 Win2003x64/64GB RAM

SE_LOG: when AAALR(1.671787) is greater than 1.000000, we suggest using new row applicator to improve time and mem effeciency..

Besides these posts,i'm interested in this part "we suggest using new row applicator to improve time and mem effeciency".

What does it mean by "row applicator" and how it can improve time and mem efficiency?

Somebody has to put some light into this.

Re: What is New Row Applicator ?

swuehl — Wed, 14 Oct 2015 17:14:40 GMT

Can't personally add something to this, but a search in the forum reveals a new post from JoeSimmons with some more detailed information:

SE_LOG: when AAALR(6.186927) is greater than 1.000000, we suggest using new row applicator to improve time and mem effec…

Re: What is New Row Applicator ?

mongolu — Wed, 14 Oct 2015 17:42:03 GMT

I see it has a solution but we don't know more details.

Thank you for your fast answer.

Re: What is New Row Applicator ?

tseebach — Fri, 29 Jan 2016 12:49:01 GMT

Hi Fredric,

If you're using the governance dashboard and the Warning level, then try to look at the message with the same timestamp which is 700. This message shows what fields is causing it.

Re: What is New Row Applicator ?

reanfadyl — Wed, 02 Mar 2016 04:32:13 GMT

‌Hi Torben, we have this issue coming up for a small number of fields in our data model. Do you have any advice on what you did next to resolve the issue?

Re: What is New Row Applicator ?

pablolabbe — Fri, 02 Sep 2016 21:31:36 GMT

Do you have any update on this issue ?

Re: What is New Row Applicator ?

Emmanuelle__Bustos — Mon, 05 Sep 2016 21:51:03 GMT

Hi Pablo,

according with Qlik Support I opened a case and the solution was:

The warning to which you are referring - QVGeneral: when AAALR(1.293973) is greater than 1.000000, we suggest using new row applicator to improve time and mem effeciency. AAALR" is a very low level concept deep in the QlikView engine. Generally speaking it means the average length of aggregation array. The longer this array is, the more RAM usage and CPU power are to be consumed by the engine to get aggregation result for every hypercube node and can thus effect performance.

When AAALR is greater than 1.0, normally the customer has a large data set and suffers slow responses and high memory usage in their app.

To mitigate this, you can add the below setting to the Settings.ini file located in the QlikTech\QlikViewServer:

DisableNewRowApplicator=0

By setting this parameter to “0”, QlikView will use an new algorithm which is optimized for large data set to do the aggregation, and will consume much less RAM and CPU power.

Re: What is New Row Applicator ?

Anonymous — Tue, 13 Sep 2016 19:25:38 GMT

Sounds promising 🙂

The question ist: why isn't it enabled out of the box, or at least mentioned in the release notes?

Have you got any information if this is a supported easter egg?

Re: What is New Row Applicator ?

fredericvillemi — Thu, 14 Sep 2017 10:39:47 GMT

One year ago, you told us to set disable new row applicator = 0

No information have been found about this setting, is it still mandatory to use it for big documents ?

Why is it not the default mode ?

Thanks

Re: What is New Row Applicator ?

Emmanuelle__Bustos — Thu, 14 Sep 2017 14:34:44 GMT

Accordin to Qliktech support:

When AAALR is greater than 1.0, normally the customer has a large data set and suffers slow responses and high memory usage in their app.

To mitigate this, you can add the below setting to the Settings.ini file located in the QlikTech\QlikViewServer:

DisableNewRowApplicator=0

By setting this parameter to “0”, QlikView will use an new algorithm which is optimized for large data set to do the aggregation, and will consume much less RAM and CPU power.

I guess it's not default because only affects large data sets environments.

Re: What is New Row Applicator ?

fredericvillemi — Thu, 14 Sep 2017 14:37:59 GMT

Ok thank you

Too bad they don't use more explicit messages or enforce the algorithm designed for large data when needed

Thanks

Re: What is New Row Applicator ?

Anonymous — Fri, 15 Sep 2017 07:35:51 GMT

Hi!

In the meantime the Qlik Support Knowledge Base article is quite clear about this setting.

See below if you might have not read about it!

Re: What is New Row Applicator ?

fredericvillemi — Fri, 15 Sep 2017 07:38:25 GMT

Hello,

thanks

yes I have made a ticket and got this article. It's clear. I still don't know why they don't use the new algorithm by default but well, I have defined the setting Disable=0 on my test server and I don't have the message anymore about AAALR

It seems to use less memory too but I need to wait for users to try it to confirm it's far better than before.

Thanks