topic Re: Add function / partial reload in Sense in App Development

Add function / partial reload in Sense

squeakie_pig — Sat, 16 Nov 2024 20:12:16 GMT

Does anyone have any suggestions for partial reload in Qlik Sense? Using the ADD function doesn't have the same functionality as Qlikview. 😞

The qvds being loaded are already incremental.
Am only wanting to add new qvd files since last reload because I don't want to have to reload the entire history every hour - it takes too long. (I already have all this logic and it works in qlikview).
Don't want to use an extension because it needs to be scheduled not dependent on someone clicking a button
Only other suggestion I've found in the forums so far is Christoph's solution using the Engine API - I haven't tried this yet because it is an Enterprise server and very locked down.

Cheers

Re: Add function / partial reload in Sense

treysmithdev — Sat, 24 Aug 2019 15:38:58 GMT

At the moment your only option is using either the API or Extensions (which are using the API). What I can suggest is working to make your reload leverage optimized QVD loads. If you can do that, it will be very fast.

Re: Add function / partial reload in Sense

squeakie_pig — Sat, 24 Aug 2019 15:48:08 GMT

Thank you @treysmithdev

You got me thinking that maybe I don't need a partial reload and my problem lies elsewhere.

Everything is already optimised. The loading is fast - 400M rows in less than 5 min. It tends to be save/publish bit that takes about 20min.

Is that something that can only be improved by boosting hardware?

Re: Add function / partial reload in Sense

treysmithdev — Sat, 24 Aug 2019 15:53:24 GMT

Saving is restricted based I/O of your server. If you are on a HDD you could switch it to a SSD and that should speed up saving. If you have multi-node environment and the reload happens on one server but is accessed on another, then that adds migration time. Only way to trim that down is have it reload on the consumer node, which can affect resources on the consumer node.

Re: Add function / partial reload in Sense

squeakie_pig — Sat, 24 Aug 2019 16:02:45 GMT

Bummer. That's what I thought 😞 Thank you for confirming.

Have marked the other answer as correct for anyone looking for info on partial reloads. 🌟