Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
manoj217
Creator III
Creator III

incremental load

HI,


i have 3yrs (2011,2012,2013)of data in the application while doing the incremental load 1 more year (2014)data is added now the performance is reduced so any options to increase the performance. if i do the same function (adding 1yr (2015)more)again data will increase  performance will reduce any suggestions.

10 Replies
Anil_Babu_Samineni

Don't reload full. Try to reload Partial Reload using ADD prefix for now.. Also, You can think Incremental Load concept to load only recent data with Club into old data

Best Anil, When applicable please mark the correct/appropriate replies as "solution" (you can mark up to 3 "solutions". Please LIKE threads if the provided solution is helpful
manoj217
Creator III
Creator III
Author

But data is increased in the Qlikview memory

stabben23
Partner - Master
Partner - Master

Hi,

are you using the incremental load in a ETL loading process or in Direct in Your Dashboard Application?

manoj217
Creator III
Creator III
Author

in application . we have created the incremental load and actions performed in qmc on every month data is increasing and old data is also existed in the qlik memory so now the performance is reduced

Anonymous
Not applicable

incremental load is the option you might look for

Anil_Babu_Samineni

Either this is from QMC not the Qlikview. Recently, One of my colleague faced the issue.

My side, The issue is Every reload happens the File size (QVW) got increased. Does this same your question? And this happened for me in QMC. Will it so?

Best Anil, When applicable please mark the correct/appropriate replies as "solution" (you can mark up to 3 "solutions". Please LIKE threads if the provided solution is helpful
Anonymous
Not applicable

As you have mentioned you have the problem in dashboard, instead of reloading.

specially you have an issue with qlikView consuming more memory.

in that case, follow the below steps:

  • you cannot skip any year of data, so skip the unwanted columns in data model.
  • identify the dimensions and facts to create a schema, so that you can easily eliminate duplicates.
  • check for synthetic keys specially.
  • if you have tried these things, but you need to keep that big data model in your memory, all you can do is taking care of your expressions and limit the values in chart

Hope it helps

Hari.

manoj217
Creator III
Creator III
Author

if i want only recent 3 yr data and i want to delete the previous years data by doing the incremental load what will be code

Anonymous
Not applicable

We don;t know your field names, so we cannot write code for you,

but i suggest you to use where condition while loading the data, and use the recent three years as values