Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi all,
I am loading an optimized QVD file of 2.3M records and using CrossTable() to get a tall thin version (130 columns to 40). During the CrossTable() part of the process I get CPU usage like the attached image (approx 20% of most cores). How do I get the process to use all available CPU power? Nothing else is going on with the server - it should be dedicated to this load process.
Thanks,
Jason
OK - thank you Henric
Henric,
I am just curious:
Assuming a CROSSTABLE prefix on a simple load with no other transformations, how should this scale on multiple CPU's?
@ swuehl: The Load statement is multi-threaded like I described above. The Crosstable prefix however, causes a second pass through the read table - a pass which is single threaded. So during this phase of the script run the CPU usage should be down at 1/32, i.e. 3%.
@ Bill Markham : The data transfer may still be a major bottleneck, so I wouldn't count your theory out.
HIC