Data reload takes more time and hanging at last

[#1]

Hi,

I have a huge report (with 26 QVDs of 700mb size in total) whose data were changed in 2 of the QVDs and reloaded. Before changing the data it took 1 hour 45 mins to reload completely , but after changing the data it took 7 hours and hung my laptop completely yesterday. Then I tried to reload again last night , after 14 hours of loading it hung my laptop again. I am not sure whether there is some problem with the new data or the data model. Please help in identifying the issue.

PFA script attached.

Regards,

James

[sujeetsingh]

Check for the coding standards and data modelling basics are done.

Best Practices for Data Modelling

[rubenmarin]

Hi James, will be good to know where it hangs. It's after a join? At the end of script?

If it's at the end of script maybe is trying to create synthetic keys because some data break the autoconcatenting, I always set the word 'Concatenate' when I want tables concatenated.

[Anonymous]

Hi James,

Could you share the execution log please?

Thanks

[marcus_malinow]

James,

a couple of thoughts:

Have you tried adding in some TRACE commands to indicate what stage the load has got to? This can help when debugging.

Have you tried running a limited load? If you have a synthetic key in your data model, this can take a long time to resolve at the end of your script.

Marcus

[Digvijay_Singh]

Can you share the current data model and previous data model to know more about the changes?

[#7]

Ruben,

It stands still when loading TABLE_Eina_EineFL for 2 hours then it hangs totally while loading TABLE_Eina_EineFL (may be after loading this completely and trying to load next table).

I know it will create 4 syn keys , out of which 2 are having more coulmns and 2 having 3 to 4 columns. Initially this was 8 and i changed script and brought it down to 4. Anyway i will take your comments and try to remove them also.

-James

[#8]

Sorry i did a limited load after a day long load. So the log file got replaced with new data. Anyway here is the new limited load's log content.

[#9]

Marcus,

No i did not use TRACE. I don't know about it actually. I will try to add it. I did a limited load but that doesn't help. Please see previous reply for log.

Jamy

[#10]

Vijay,

SInce the data did not load completely after changing data , i cannot provide the new data model. So attaching the old one.