Skip to main content
Announcements
Accelerate Your Success: Fuel your data and AI journey with the right services, delivered by our experts. Learn More
cancel
Showing results for 
Search instead for 
Did you mean: 
dreweezy
Creator II
Creator II

Data load duration - how to optimize

Lets say I have 3 tables in my database with a linkage for Qlik Sense. When I bring this data in with basic computation it takes a good 20-30 minutes for it to all load. If i wanted to make a small change in a computation or maybe do a join to a new table I will be bringing in, how do I tell Qlik to just do that incremental load vs. going through the whole process again? Thanks.

Labels (2)
3 Replies
JustinDallas
Specialist III
Specialist III

Is the process taking forever during the data extraction process, or the datamodel creation process?  In my setup, I have one setup of apps that simply pull down the data, and then I have another set that builds the building blocks for my datamodel.  

 

Doing an incremental load on the different stages requires slightly different logic.

dreweezy
Creator II
Creator II
Author

I believe it would be the data model loading section. I do know the syntax may be different but for simplistic reasons I want to do a quick join on another table that I'll edit in my data editor script. Once I load it, it seems that the load looping through all the tables instead of just that one new syntax/statement I want to achieve.

JustinDallas
Specialist III
Specialist III

To do this sounds like it would be more trouble than it's worth.  If load times are bothering you, try splitting your load work amongst multiple apps.  That way, you don't have to reload the entire world after making a change.  For me, I have 3 apps that I use to create the datamodel.