Qlik Community

QlikView Scripting

Discussion Board for collaboration on QlikView Scripting.

eanderson
New Contributor

QVD Load fast, but linking model takes a long time

Good day,

I load 16 QVD files to build a model of which the biggest DVD at the moment is 500 MB, another 117 MB and the rest of the QVD files are small in comparison, i,e, 20, 11, 9, 5 and  1 MB and smaller. 

Loading the QVD files is fast: 1min and 30 secs, however after the QVD's are loaded, I assume QlikView is building or linking the model and this takes very long…  At this point in time I have not waited long enough for it to finish, since I think there's something wrong ?

Records coutns are as follows:

Connected
POL_ENTITIES << ENTITIES (qvd optimized) 99,623 lines fetched
PERSON_ENTITIES << ENTITIES (qvd optimized) 99,623 lines fetched
CLAIM_LINES << CLAIM_LINES 2,991,806 lines fetched
CLAIM_HEADERS << CLAIM_HEADERS 5,082 lines fetched
POLICY_PORTFOLIOS << POLICY_PORTFOLIOS 2,859 lines fetched
PROVIDERS << PROVIDERS 297,398 lines fetched
COMM_PM_ENTITIES << COMM_PM_ENTITIES 230,613 lines fetched
COVER_PORTFOLIO << COVER_PORTFOLIO 31,616 lines fetched
PERSONS << PERSONS 40,342 lines fetched
USER_VARIABLEINSTANCELOGS << USER_VARIABLEINSTANCELOGS 60,219 lines fetched
COUNTRY_VARIABLEINSTANCELOGS << COUNTRY_VARIABLEINSTANCELOGS 7,543 lines fetched
REF_VARIABLEINSTANCELOGS << REF_VARIABLEINSTANCELOGS 81,750 lines fetched
TRANSACTION_REASONS << TRANSACTION_REASONS 177,550 lines fetched
REASON_CODES << REASON_CODES 163 lines fetched
REASON_TYPE_CODES << REASON_TYPE_CODES 174 lines fetched
FINANCIAL_TRANSACTIONS_VW << FINANCIAL_TRANSACTIONS_VW 4,433,804 lines fetched
BENEFICIARIES << BENEFICIARIES 71,425 lines fetched

Looking at CPU and Mem, CPU is @ 50 % and Memory 1433 MB used and 609 MB free.

Is there a way to see what QlikView is doing at this point in time since I can see no progress and I can not press the Close button on the Script Execution Progress window.

Thank you in advance for your feedback.

Kind regards

Edwin

Tags (1)
3 Replies

Re: QVD Load fast, but linking model takes a long time

Perhaps your datamodel isn't proper and there are synthetic keys. These calculation could take many hours .... I suggest not to load all qvd at once then step by step and then look in the log-files and the table-viewer.

- Marcus

brijesh1991
Contributor III

Re: QVD Load fast, but linking model takes a long time

Remove Synthetic Keys and build your model by approaching star schema.

eanderson
New Contributor

Re: QVD Load fast, but linking model takes a long time

Yes thank you, by gradually adding it resolved the problem.

Thanks that helped a lot.

Kind regards

Edwin

Community Browser