Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
I am loading the data from QVDs. But it is hanging. I have enough RAM size.
What may be the reasons?
Thanks in advance.
Hi,
Check whether you are using any Join (Left/Right/Inner) without any common column in both the tables? Usually this will cause the issue, since it will do Cartesian product so it will take huge time to reload the data.
Suppose if you have 1 millions in both the tables, then it will create 1 Million * 1 Million rows in the new table.
Regards,
Jagan.
Hi,
Is there any synthetic Key or Circular loop in it???
Try Debug with limited load..
Regards
Hi
Check List:
There might be some problem with the your Data Model.
The way you have Linked Several Qvds in your Script.
Data might be Multiplying (One to Many Relationship). Try to handle that.
Check your Joins - Left Join, Outer Join..... whatever you have used.
There might have some Synthetic Keys or Circular Loops forming in your Application.
Hope that helps.
Regards
Av7eN
You could name each table load like QVD1: QVD2: ...
and write a QUALIFY *; at the beginning (and an UNQUALIFY *; at the end of the loads) to load the data without accidentally creating joins/concats/synth. keys and to investigate the fields and values
Hi QW,
my best idea is first u need to debug this with 1000 records if it gives result then check your data model(synthetic keys,circular loops...etc)
-> when u reloading your application open "windows task Manager" performance tab is gradually increasing and it reaches to max RAM utilization then automatically(System hangs at this time) it defines that you did a mistake in your Data model.
Hi,
Check whether you are using any Join (Left/Right/Inner) without any common column in both the tables? Usually this will cause the issue, since it will do Cartesian product so it will take huge time to reload the data.
Suppose if you have 1 millions in both the tables, then it will create 1 Million * 1 Million rows in the new table.
Regards,
Jagan.
Hi,
Yes, as Jagan mohan said if we apply any joins in the script and don't have a common key data reload time will take more time and some time it might be unresponsive as well.
even if we debug with limited load also we may face similar issue, my suggestion is go to script and see the common key is there or not and use Exit Script; after every single table with limited load in debug mode.