Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
techvarun
Specialist II
Specialist II

scrip not ending

Hi All

I have 2 qvd files with same fields 183 fields

one qvd is 21 GB and another one is 8 GB...

The scripp load ended in 15 mins but the process running for hours it is not ended still...

Please suggest something to complete the execution

Thanks

Varun

11 Replies
Anonymous
Not applicable

Kill the process.

techvarun
Specialist II
Specialist II
Author

I need to get the data loaded as well

Thanks

Varun

sunny_talwar

These two QVDs were concatenated to each other in QlikView or were they part of two different tables in QlikView? Cause if they had the same field names and were sitting in two different tables, it might take a long time (forever) for QlikView to create a synthetic key for 183 fields.

Best,

S

PrashantSangle

Hi,

Which process is not ending??

Regards

Great dreamer's dreams never fulfilled, they are always transcended.
Please appreciate our Qlik community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂
techvarun
Specialist II
Specialist II
Author

community.png

PrashantSangle

Hi,

Try loading with individual QVD.

Check how much time it takes.

Regards

Great dreamer's dreams never fulfilled, they are always transcended.
Please appreciate our Qlik community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂
Anonymous
Not applicable

Hi,

Try loading with limit load.

are you using any transformations while loading?

Usually if you have different table structure for both qvds,synthetic keys will be created and it will take long time to

load completed.

Another way is break qvd's year wise and use them,so for analysis how many years you need use those qvd's only

Regards

Neetha

sunny_talwar

Is the intention to concatenate the two qvds? If that is the intention, I would do something like this

MASTERFINAL:

LOAD your 183 fields

From Mater_Load.qvd;

Concatenate (MATERFINAL)

LOAD your 183 fields

From Mater_Load1.qvd;

If you don't need to concatenate them for any reason then I would do something like this:

Qualify *;

MASTERFINAL:

LOAD your 183 fields

From Mater_Load.qvd;

MASTERFINAL1:

LOAD your 183 fields

From Mater_Load1.qvd;

UNQUALIFY *;

You may already be doing this, or something better, but I just thought the throwing this out may resolve a minor un-noticed mistake.

Best,

S

johnca
Specialist
Specialist

What I find interesting is that one QVD has 393 million lines (21GB) and the other 12 million lines (8GB). These ratios are not even close to being similar, and I would expect them to be, if the data were similar.

Is the data similar or is one populated with larger data fields?

Also, what is typical when the fields are the same is the 2nd qvd to load would show the 12 million lines added to the first line counts...

MASTERFINAL << Master_Load (qvd optimized) 392,651,172 lines fetched

MASTERFINAL-1 << Master_Load (qvd optimized) 404,461,406 lines fetched

not MASTERFINAL-1 << Master_Load (qvd optimized) 11,810,234 lines fetched

I suspect the fields are not all the same and QV is trying to create a synthetic key.

HTH,

John