topic SV:parallel processes in QlikView

parallel processes

Mon, 27 Jul 2009 15:21:52 GMT

Hello,

I load a lot of tables from SAP system and save them in QVD files in my QlikView server.

I operate this process with BAT file from windows scheduler.

This process takes a very long time.

I want to break the big process to some processes that can run parallel.

How can I do it? I cannot succeed to run in 1 BAT file in parallel more then one QlikView session.

Elad

SV:parallel processes

Tue, 28 Jul 2009 19:23:58 GMT

When parallell loading is possible why can't you separete them in to multiple batchfiles and schedule them separately?

/Michael

SV:parallel processes

Tue, 28 Jul 2009 19:28:10 GMT

If you use QVS, why don't you run Reload tasks at the same time ?

SV:parallel processes

Tue, 28 Jul 2009 19:32:48 GMT

Hello Michael,

Thank you for your answer.

I'm not succeeding to open more then 1 window that run QV file in the same time.

Elad

parallel processes

Tue, 28 Jul 2009 19:33:49 GMT

Does your version of server come with the basic publisher edition? It would handle all these tasks for you.

parallel processes

Tue, 28 Jul 2009 19:37:45 GMT

What is basic publisher edition?

SV:Re: parallel processes

Tue, 28 Jul 2009 21:32:53 GMT

In version 8 you can install standard publisher which you can use for parallell reloading. This is what I use and it is free with the server license. Enterprise adds the ability to distribute the reports. It irequires a separate license.

In version 9 they are bundled together. Haven't used that one yet.

/Michael

parallel processes

disqr_rm — Tue, 28 Jul 2009 22:04:48 GMT

Hi Elad,

What you can do is create one batch file for each extract (SAP -> QVD) program and run them in background using any method - windows scheduler, publisher, any 3rd party scheduler, etc.

So you would have MARA.bat, VBAK.bat..... You get the idea. And then schedule these bat files parallel. Using windows scheduler, make sure to log off before jobs start, if you used the same login credentials in the batch job as well.

When running in background, QV extracts will run parallel without any problem.

Now, I assume that you want extract different tables (MARA, VBAK, ...) parallel and not the same huge table in multiple chunks (using number range, etc.) and later merge these QVDs later. Anyway, this is very well possible as well.

Hope this helps.