Reload task takes lot of time to run and the RAM usage on server goes down

[#1]

Reload task lots of time to run and the RAM usage on server goes down to 91.97% of total 32GB RAM.

How to resolve the issue permanently? Since the developers uses very large data and not using the performance optimization, we are facing this issue since long time.

How to resolve this issue permanently or to educate the developers. Please suggest and provide some solutions for our issue.

[giakoum]

https://qlikcentral.com/2014/08/19/the-optimal-qlikview-data-structure/

A perfect datamodel?

You need a senior developer to lead / teach your developers I guess

[Anonymous]

Performance and Optimization Best Practices in QlikView & Qlik Sense

[Anonymous]

Hi, Vinu,

For your case, there are many ways to solve the problem based on the data requirement of the dash.

If you do not want to redesign the dash, then you can first check 2 things:

1. If you do not use QVD, pls use QVD.

2. If only the latest date period is needed, only load data for the last few weeks/months.

If you already use the above 2, then you need to redesign the data model as suggested by the above 2 replies.

Zhihong

[#5]

Apart from thinking from Developer point of view, is there any way to resolve the issue from server side?

[Colin-Albert]

Adding more resources to the server is not a fix for a poor data model. The first place to look is your data model.

My guess is the RAM is being consumed in calculating synthetic keys.

Can you test a limited load of say 10 rows and review the model. Perhaps post an image from the Table Viewer.

If you have synthetic keys then eliminate them.

Review the document log as this will show which stages are consuming the most time in the reload task and indicate what sections of the script to optimise.

[ramasaisaksoft]

Hi Priya,

one solution is there but not sure how much it will help to your scenario

1) Load this job only at this particular time

means :-no other jobs will reload till this job completion.

and better to schedule this job at non-business hours so that Job will utilize Total RAM and complete ASAP.

After doing that also If you didn't get performance we need to take with development team help only