topic Load data, but run multiple at same time in QlikView

Load data, but run multiple at same time

mattdaubney — Sat, 16 Nov 2024 18:55:35 GMT

Am sure this has been asked many times, but I can't see a solution.

I am loading many SQL tables into qvds. My current way of working is load table a, then load table b, load table c etc. However as each table is built in turn it is taking a long time to complete, eg table a is a second, table b takes 8 minutes, table c takes 10 minutes, therefore the whole load is taking 18 minutes and a second, but if I could run them together then I could get that time down to 10 minutes.

As I need to build the qvds nightly, I have set up a scheduled task in qlik qmc to do all of the builds and also refresh reports. (I build data level qvd, then when complete it then builds the business layer qvd and then refreshes reports), this can take a long time to complete, but if I could build the longer running qvd in a smarter way, ie multiple together I could trim this time down considerably

Is it possible to do this?

Thanks in advance

Re: Load data, but run multiple at same time

tresB — Wed, 18 Mar 2020 11:18:27 GMT

What about creating multiple qvw files for each load and running them in parallel?

Re: Load data, but run multiple at same time

mattdaubney — Wed, 18 Mar 2020 12:25:13 GMT

Hi. Thanks for reply, I can see how I can create the different qvw, i.e. these load quickly, this one and this one take ages, so split them out, but how do I set them to run in parallel? I need the QVMC to call the builds, so do I need to create a batch file and call it from the QVMC and when successful continue with build business layer. (Apologies, it's all a steep learning curve regards this for me at moment.)

Re: Load data, but run multiple at same time

Brett_Bleess — Tue, 14 Apr 2020 12:27:32 GMT

You did not say if you have Publisher license or if you are using the basic Reload Engine as the reloading mechanism? Basically, what you want to look into is the On Successful Completion of another task trigger to chain things together...

https://help.qlik.com/en-US/qlikview/April2019/Subsystems/QMC/Content/QV_QMC/QMC_Documents_UserDocuments_Reload.htm#On_event_from_another_task

https://help.qlik.com/en-US/qlikview/April2019/Subsystems/QMC/Content/QV_QMC/QMC_Documents_SourceDocuments_Triggers.htm

First link relates to the Reload Engine, second is for Publisher, that should put you on the right track.

Regards,
Brett