topic Re: scrip not ending in QlikView

scrip not ending

techvarun — Sat, 07 Feb 2015 12:11:18 GMT

Hi All

I have 2 qvd files with same fields 183 fields

one qvd is 21 GB and another one is 8 GB...

The scripp load ended in 15 mins but the process running for hours it is not ended still...

Please suggest something to complete the execution

Thanks

Varun

Re: scrip not ending

Anonymous — Sat, 07 Feb 2015 12:13:12 GMT

Kill the process.

Re: scrip not ending

techvarun — Sat, 07 Feb 2015 12:14:50 GMT

I need to get the data loaded as well

Thanks

Varun

Re: scrip not ending

sunny_talwar — Sat, 07 Feb 2015 12:18:20 GMT

These two QVDs were concatenated to each other in QlikView or were they part of two different tables in QlikView? Cause if they had the same field names and were sitting in two different tables, it might take a long time (forever) for QlikView to create a synthetic key for 183 fields.

Best,

Re: scrip not ending

PrashantSangle — Sat, 07 Feb 2015 12:20:00 GMT

Hi,

Which process is not ending??

Regards

Re: scrip not ending

techvarun — Sat, 07 Feb 2015 12:27:16 GMT

Re: scrip not ending

PrashantSangle — Sat, 07 Feb 2015 12:34:56 GMT

Hi,

Try loading with individual QVD.

Check how much time it takes.

Regards

Re: scrip not ending

Anonymous — Sat, 07 Feb 2015 12:51:28 GMT

Hi,

Try loading with limit load.

are you using any transformations while loading?

Usually if you have different table structure for both qvds,synthetic keys will be created and it will take long time to

load completed.

Another way is break qvd's year wise and use them,so for analysis how many years you need use those qvd's only

Regards

Neetha

Re: scrip not ending

sunny_talwar — Sat, 07 Feb 2015 13:26:16 GMT

Is the intention to concatenate the two qvds? If that is the intention, I would do something like this

MASTERFINAL:

LOAD your 183 fields

From Mater_Load.qvd;

Concatenate (MATERFINAL)

LOAD your 183 fields

From Mater_Load1.qvd;

If you don't need to concatenate them for any reason then I would do something like this:

Qualify *;

MASTERFINAL:

LOAD your 183 fields

From Mater_Load.qvd;

MASTERFINAL1:

LOAD your 183 fields

From Mater_Load1.qvd;

UNQUALIFY *;

You may already be doing this, or something better, but I just thought the throwing this out may resolve a minor un-noticed mistake.

Best,

Re: scrip not ending

johnca — Sat, 07 Feb 2015 16:20:05 GMT

What I find interesting is that one QVD has 393 million lines (21GB) and the other 12 million lines (8GB). These ratios are not even close to being similar, and I would expect them to be, if the data were similar.

Is the data similar or is one populated with larger data fields?

Also, what is typical when the fields are the same is the 2nd qvd to load would show the 12 million lines added to the first line counts...

MASTERFINAL << Master_Load (qvd optimized) 392,651,172 lines fetched

MASTERFINAL-1 << Master_Load (qvd optimized) 404,461,406 lines fetched

not MASTERFINAL-1 << Master_Load (qvd optimized) 11,810,234 lines fetched

I suspect the fields are not all the same and QV is trying to create a synthetic key.

HTH,

John

Re: scrip not ending

Gabriel — Sat, 07 Feb 2015 22:27:17 GMT

Hi,

One of the QVD file contain high number of NULLs, and there's join happening after the load has completed hence the script execution window not closing.

A quick check is to load each QVD and check for number of null using NULLCOUNT function, this should tell you the story. The the solution is to convert those NULLs to something may be Uknown then concatenate the QVD files

Re: scrip not ending

ashfaq_haseeb — Sun, 08 Feb 2015 06:39:11 GMT

Hi,

Make sure you have enough ram.

and make sure that you have same table structure and same fields.

I would say qlik here is case sensitive.

if you don't have same field names it will create synthetic key. Which inturn for sure will take time.

try by force concatenate as well.

Regards

ASHFAQ