Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us to spark ideas for how to put the latest capabilities into action. Register here!
cancel
Showing results for 
Search instead for 
Did you mean: 
ArunaVeerappan
Partner - Contributor
Partner - Contributor

Reduce reload time

How do I reduce app reload time when working with large data sets?

 

Labels (1)
2 Replies
robert_mika
Master III
Master III

Try if you have not doing this yet: 


- Instead of reloading the entire dataset every time, load only new or changed records.

WHERE LastModifiedDate > $(vLastReloadDate)
Store vLastReloadDate in a variable or QVD

-Split logic into Extract → Transform → Load (ETL) layers

- Avoid nested transformations during reload

- Limit the number of fields during load:

qlik
LOAD ID, Name, Date FROM ...;
Drop unused fields immediately

- Avoid LOAD * unless absolutely necessary

- Use WHERE Clauses and Filters
Filter data at the source:

SQL SELECT * FROM Orders WHERE OrderDate >= '2023-01-01';
Reduces volume before it hits Qlik

- Avoids unnecessary memory usage

- Optimize Joins and Keys
Use numeric keys for joins (faster than strings)

Vegar
MVP
MVP

In addition to @robert_mika 's list, I would also mention the speed differences between fetching data from qvd files in an optimised or a non-optimised load.

I think Bitmetric with @barryharmsen  have a pretty good explanation of optimised load in this blog post from 2022. https://www.bitmetric.nl/blog/qlik-optimized-load/