topic Re: Load hangs when loading multiple qvd. files in QlikView

Load hangs when loading multiple qvd. files

Anonymous — Tue, 01 Dec 2015 19:36:17 GMT

Hi All, is anyone else having this issue? When I try to load more that 1 qvd file my load script hangs. This issue just cropped up several weeks ago and I can't seem to figure out why.

It seems to load all lines from both qvd files but then hangs. The elapsed time counter doesn't move and I end up having to abort the load.

Re: Load hangs when loading multiple qvd. files

Anonymous — Tue, 01 Dec 2015 19:52:35 GMT

You may well be creating a huge synthetic key somehow.

Try running in debug mode and only load say 10 rows, then look at the resultant data model.

Re: Load hangs when loading multiple qvd. files

b_garside — Tue, 01 Dec 2015 19:53:34 GMT

It may be trying to create Synthetic keys in which case it can easily hang. Seen this happen all the time.

Another time I saw some code where they were loading 1+ qvds to be "Auto' concatenated it froze every time.

So we added the command Concatenate between each load and all was well.

Each case is different, but hopefully that will get some ideas flowing.

Re: Load hangs when loading multiple qvd. files

Anonymous — Tue, 01 Dec 2015 20:46:52 GMT

Thanks Bill - I tried that, it loads 10 rosw and promplty hangs, which makes it hard to look a the results.

Re: Load hangs when loading multiple qvd. files

Anonymous — Tue, 01 Dec 2015 20:54:30 GMT

Brian - thanks for this. I'm not sure what a synthetic key is (assume it is some kind of key that is automatically created by Qlikview?). Would you be so kind as to provide an example of your Concatenate command. I have tried it the script fails completely.

Thanks

Simon

Re: Load hangs when loading multiple qvd. files

b_garside — Tue, 01 Dec 2015 21:06:36 GMT

See if you can post some of the script or the general structure of it. That may help the community narrow it down to the root cause.

Re: Load hangs when loading multiple qvd. files

b_garside — Thu, 03 Dec 2015 14:22:31 GMT

Typically Concatenate goes between Load statements;

If you provide a sample script myself or Bill may be able to help more.

Synthetic keys are autogenerated as you said as a result of fields named the same.

So if QV doesn't know to concentrate, so it tried to create "Keys" in this case maybe too many then it freezes.

I had a colleague loading 3 QVD it froze each time. Only worked when he loaded one.

To load three he had to use Concatenate to tell the engine to to not create separate table but one large one.

Status1:

LOAD @1 as mbyte,

@2 as typ,

@3 as menge

FROM

$(vfrom1)

(txt, codepage is 1252, no labels, delimiter is ';');

Concatenate (Status1)

LOAD @1 as mybte,

@2 as typ,

@3 as menge,

'$(vfrom2) As Quelle

FROM

$(vfrom2)

(txt, codepage is 1252, no labels, delimiter is ';');

Re: Load hangs when loading multiple qvd. files

Anonymous — Wed, 09 Dec 2015 18:36:07 GMT

Brian - thanks very much for the insite and help. I've the Concatenate command to solve the issue!

Thanks again,

Simon