Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Memory Management

How to reduce the reload  time of the application as it take 127 GB Ram out of 128 GB ram allocated to the system

I am  not able to open other application

13 Replies
ashfaq_haseeb
Champion III
Champion III

Hi,

Its totally depend on your model and how you design it.

How many records do you load?

you can try by splitting your data into smaller qvd's.

Make sure you  don't have multiple sessions opened by end users.

Do not load unnecessary fields.

Regards

ASHFAQ

salto
Specialist II
Specialist II

Hello Shweta,

have you tried to reload the document with a subset of data, and then check your data model?

vinay_hg
Creator III
Creator III

Hi,

1. do not consider the fields which are not required in ETL and in presentation qvw.

2. try to use proper data schemas in data modelling.

3. try not to use nested if conditions in expressions, instead use set analysis.

4.dont use too much variables for calucaltions in presentation QVW.

5. dont right big expressions in the presentaions, try to bring calculated values from model level.(script level). i mean split your application into layers like extract(qvw) where you will load data nd creat raw qvd, then load required data only from qvds to qvw file model layer. i nscript level try to do all calculation. end result save it in again qvd or load this qvw into presentation qvw.

so by all this load on the presentation qvw file will be lesser. and takes less RAM while loading and run/open faster.

Regards

vinay

Not applicable
Author

they have records in crores

We have already divided the coding application into 2 parts ,But  still its 1st  part takes  21 hours and 2nd parts take 6 hours

ashfaq_haseeb
Champion III
Champion III

In that case make sure you have enough ram.

Look at below post for memory management and ram sonsumption.

http://community.qlik.com/message/455415#455415

http://community.qlik.com/message/455396#455396

Regards

ASHFAQ

vinay_hg
Creator III
Creator III

are you using proper data modelling or schema in 2 parts? is all crore data columns are required? is it able comment some column?

and according to me it should not take 21hours and 6hours to load. how many tables data you are loading in each part? what kind of relation b/t them you had created?

Not applicable
Author

we follow  3 tier architecture -

1.first qvd generator takes 3 hours

2.data model app divided into  2 parts -1st take 21 hours and other take  6 hours

3.main qvw( having design)- take 15 min

All the calculation  has done at 2nd level ,i used variable & set analysis

vinay_hg
Creator III
Creator III

ok tell me in data modelling, 2 parts how many tables or qvds you r loading to dod calculation?

and what is the data schema you had prepared b/t tables(star or sowflex or all data concatinated to single table) in each parts?

Not applicable
Author