Qlik Community

QlikView Scripting

Discussion Board for collaboration on QlikView Scripting.

bigsi
New Contributor II

Load hangs when loading multiple qvd. files

Hi All, is anyone else having this issue?  When I try to load more that 1 qvd file my load script hangs.  This issue just cropped up several weeks ago and I can't seem to figure out why. 

It seems to load all lines from both qvd files but then hangs.  The elapsed time counter doesn't move and I end up having to abort the load.

12-1-2015 2-30-12 PM.jpg

1 Solution

Accepted Solutions
b_garside
Valued Contributor

Re: Load hangs when loading multiple qvd. files

Typically Concatenate goes between Load statements;

If you provide a sample script myself or Bill  may be able to help more.

Synthetic keys are autogenerated as you said as a result of fields named the same.

So if QV doesn't know to concentrate, so it tried to create "Keys" in this case maybe too many then it freezes.

I had a colleague loading 3 QVD it froze each time. Only worked when he loaded one.

To load three he had to use Concatenate to tell the engine to to not create separate table but one large one.

Status1:

LOAD @1 as mbyte,

@2 as typ,

@3 as menge

FROM

$(vfrom1)

(txt, codepage is 1252, no labels, delimiter is ';');

Concatenate (Status1)

LOAD @1 as mybte,

@2 as typ,

@3 as menge,

'$(vfrom2) As Quelle

FROM

$(vfrom2)

(txt, codepage is 1252, no labels, delimiter is ';');

7 Replies

Re: Load hangs when loading multiple qvd. files

You may well be creating a huge synthetic key somehow.

Try running in debug mode and only load say 10 rows, then look at the resultant data model.

b_garside
Valued Contributor

Re: Load hangs when loading multiple qvd. files

It may be trying to create Synthetic keys in which case it can easily hang. Seen this happen all the time.

Another time I saw some code where they were loading 1+ qvds to be "Auto' concatenated it froze every time.

So we added the command Concatenate between each load and all was well.

Each case is different, but hopefully that will get some ideas flowing.

bigsi
New Contributor II

Re: Load hangs when loading multiple qvd. files

Thanks Bill - I tried that, it loads 10 rosw and promplty hangs, which makes it hard to look a the results.

bigsi
New Contributor II

Re: Load hangs when loading multiple qvd. files

Brian - thanks for this.  I'm not sure what a synthetic key is (assume it is some kind of key that is automatically created by Qlikview?).  Would you be so kind as to provide an example of your Concatenate command.  I have tried it the script fails completely.

Thanks

Simon

b_garside
Valued Contributor

Re: Load hangs when loading multiple qvd. files

See if you can post some of the script or the general structure of it. That may help the community narrow it down to the root cause.

b_garside
Valued Contributor

Re: Load hangs when loading multiple qvd. files

Typically Concatenate goes between Load statements;

If you provide a sample script myself or Bill  may be able to help more.

Synthetic keys are autogenerated as you said as a result of fields named the same.

So if QV doesn't know to concentrate, so it tried to create "Keys" in this case maybe too many then it freezes.

I had a colleague loading 3 QVD it froze each time. Only worked when he loaded one.

To load three he had to use Concatenate to tell the engine to to not create separate table but one large one.

Status1:

LOAD @1 as mbyte,

@2 as typ,

@3 as menge

FROM

$(vfrom1)

(txt, codepage is 1252, no labels, delimiter is ';');

Concatenate (Status1)

LOAD @1 as mybte,

@2 as typ,

@3 as menge,

'$(vfrom2) As Quelle

FROM

$(vfrom2)

(txt, codepage is 1252, no labels, delimiter is ';');

bigsi
New Contributor II

Re: Load hangs when loading multiple qvd. files

Brian - thanks very much for the insite and help.  I've the Concatenate command to solve the issue!

Thanks again,

Simon

Community Browser