topic Reg:What are optimization techniques available in QlikView? in QlikView

Reg:What are optimization techniques available in QlikView?

Wed, 12 May 2010 06:31:31 GMT

Hi All,

Wishes from Jai.I have developed one QVW i n material costing.The size of the application about 66929KB.So I would like

to reduce the file size as well as improve the performance.Since I am new to the optimization techniques I dont have much knowladge

about it.So let me know in which ways,how can I improve the performance of the application?What are the optimization techniques available.

Note:

I am linking the tables using 'KEY' fields.So there is no synthetic keys avilable.

Thanks & Regards

Jai

Reg:What are optimization techniques available in QlikView?

spsrk_84 — Wed, 12 May 2010 07:13:43 GMT

Hi Jai,

Did u created the Qvd's ? if not create the qvd's from the data and use qvd files for your analysis,but this process is bit time consuming since at first u need to store raw data into qvd and then u need to fetch these qvd's into Another Qvw application for your analysis..

When u convert/store the raw data from database into qvd format the original data will be compressed up to 90%,this is the advantage...

Second thing dont perform the calculations in the GUI ie. do not write complex expressions in any chart or pivot tables try to perform or try to elminate the calculations in the front end and do them in the script level itself

Third thing like if u r using any if statements in the expressions of charts try to elminate them,instead of that u generate a flag indicator i.e

example if u want to count the no of employess with Sal >10K then do this in the script like

if(sal> 10K,1,0) as Empcount

and when u use this in the expression inthe chart u can use like just sum(EmpCount) which will gives the correct result

Apart from the above listed there are few other techniques ike

Elminate Synthetic keys in the Data Cloud.....

Regards,

Ajay

Reg:What are optimization techniques available in QlikView?

Wed, 12 May 2010 07:33:00 GMT

Hi Jai,

In addition to that, using set analysis and removing unused fields from the application is also would improve the performance of the application

- Peterson

Reg:What are optimization techniques available in QlikView?

Wed, 12 May 2010 07:45:21 GMT

Hi Ajay,

Thanks a lot for your kind reply.As per your instruction almost I have implemented all the things.Lik

1.I am using QVD Files only.I am pulling data from QVD.There is one settlement table is available which is having 36lakhs rows of data.So totally I am handling almost 70 Lakhs of data.

2.I am using calculation on Object level.But fields were coming from different tables. So I cant write calculation on back end as you mentioned making flag.If it is possible let me know how to handle this.

Client saying

Example from BOM comparison:

ItemGroupName accounting for 7mb RAM usage while ItemGroupNames only account for 50 records per DataAreaID. The fields ought to be contained in a small separate table which would use only 6kb of ram

So how can I view item how much taking RAM consumption in application.Is it possible?Let me know

Thanks & Regards

Jai

Reg:What are optimization techniques available in QlikView?

Wed, 12 May 2010 07:45:54 GMT

Hi Ajay,

Thanks a lot for your kind reply.As per your instruction almost I have implemented all the things.Lik

1.I am using QVD Files only.I am pulling data from QVD.There is one settlement table is available which is having 36lakhs rows of data.So totally I am handling almost 70 Lakhs of data.

Client saying

Example from BOM comparison:

ItemGroupName accounting for 7mb RAM usage while ItemGroupNames only account for 50 records per DataAreaID. The fields ought to be contained in a small separate table which would use only 6kb of ram

So how can I view item how much taking RAM consumption in application.Is it possible?Let me know

Thanks & Regards

Jai

Reg:What are optimization techniques available in QlikView?

Wed, 12 May 2010 07:49:04 GMT

Hi Kevin,

Thanks for your kind reply. As per your instruction I have already Implemented Set analysis in Object level and I have removed unwanted fields.Still its having almost 66MB of file size.So let me know other way of techniques.

Thanks & Regards

Jai

Reg:What are optimization techniques available in QlikView?

Wed, 12 May 2010 07:57:04 GMT

Hi Jai,

Avoiding resident load for larger data set will also improve the performance.

Performance issue..? Can you please explain the problem exactly...?

are you getting the issue at the time of opeing the application or at the time of navgation or any object in your application taking time..?

Can you please post your datamodel here so that it would be easy for us to suggest some solution

- Peterson.

Reg:What are optimization techniques available in QlikView?

Wed, 12 May 2010 08:06:27 GMT

Dear Kevin,

Here with I have attached Data Model.As per client,application is very large about 66MB.And some of Object consuming more amount in RAM.There is no issues with opening and navigating in the application.So issue with size of the application.So let me know the same

Reg:What are optimization techniques available in QlikView?

Wed, 12 May 2010 08:14:02 GMT

Hi,

Would it be possible for you to optimize the object i.e. object expression and check the performance.

can you post the expression of the objects which take time to load?

- Peterson

Reg:What are optimization techniques available in QlikView?

Wed, 12 May 2010 09:15:46 GMT

Hi all,

here is an interesting post regarding optimization and QV data structure:

http://community.qlik.com/forums/p/16328/63605.aspx#63605

Participants to this thread are Qlikview masters 😉

Regards

Olivier

Reg:What are optimization techniques available in QlikView?

johnw — Thu, 13 May 2010 02:05:24 GMT

Another thing to do is eliminate fields that you're loading but not actually using anywhere, or used in the script but don't need once the script is complete. While I try to eliminate unnecessary fields as I go, sometimes I'm lazy or miss a few. Rather than spend hours looking through the script and all of the objects, I just load up Rob Wunderlich's document analyzer, and let IT tell me which fields I'm not using.

http://robwunderlich.com/Download.html

Another thing to do is to export a .mem file from the application, then look through it for things that don't look right to you. At the very least you'll get a much better idea where all the memory is going. Settings -> Document Properties -> Memory Statistics. As I recall, you can just load the .mem file like any other file you would load into QlikView, but it's been forever since I've done it.

Reg:What are optimization techniques available in QlikView?

bimartingo — Fri, 27 Apr 2012 17:53:30 GMT

Hi leroy,

could you please inform the post's title? The link isn't pointing to any valid post

Thanks

Re: Reg:What are optimization techniques available in QlikView?

robert99 — Sun, 06 Apr 2014 11:31:33 GMT

Just what I want