Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
 dafnis14
		
			dafnis14
		
		
		
		
		
		
		
		
	
			
		
		
			
					
		Hi,
I have a script similar syntax to the following. After upgrade, it takes 2:15 hours instead of 30 minutes..
LOAD X,
SUM(Y) AS SUM_Y,
MAX(Z) AS MAX_Z
FROM c:\XXX
WHERE MATCH(W, 'AAA','BBB','CCC')
GROUP BY X;
Looks like the combination of the aggregation with the Match causes this.
Any idea why?
Thanks!
Message was edited by: Dafnis X Fixed the Group By clause
 
					
				
		
 sasiparupudi1
		
			sasiparupudi1
		
		
		
		
		
		
		
		
	
			
		
		
			
					
		Hi Dafnis
Are you loading the data from a qvd? if this is the case, your group by and match will loose the optimization.
I would suggest you load the table in memory and then do the aggregation
ex:
t1:
LOAD X,
Y
Z
FROM c:\XXX;
T2:
LOAD X,
SUM(Y) AS SUM_Y,
MAX(Z) AS MAX_Z
Resident T1
WHERE MATCH(W, 'AAA','BBB','CCC')
GROUP BY X;
This should improve the performance
 Chanty4u
		
			Chanty4u
		
		
		
		
		
		
		
		
	
			
		
		
			
					
		you can try like
WHERE W like 'AAA','BBB','CCC';
 
					
				
		
 sasiparupudi1
		
			sasiparupudi1
		
		
		
		
		
		
		
		
	
			
		
		
			
					
		LOAD X,D
SUM(Y) AS SUM_Y,
MAX(Z) AS MAX_Z
FROM c:\XXX
WHERE MATCH(W, 'AAA','BBB','CCC')
GROUP BY X,D;
 dafnis14
		
			dafnis14
		
		
		
		
		
		
		
		
	
			
		
		
			
					
		Hi Sasidhar,
The original script is correct.
Just fixed my example to the correct syntax.
Another words, there is probably some performance issue with the Group By and Match.
Thanks!
 
					
				
		
 sasiparupudi1
		
			sasiparupudi1
		
		
		
		
		
		
		
		
	
			
		
		
			
					
		Hi Dafnis
Are you loading the data from a qvd? if this is the case, your group by and match will loose the optimization.
I would suggest you load the table in memory and then do the aggregation
ex:
t1:
LOAD X,
Y
Z
FROM c:\XXX;
T2:
LOAD X,
SUM(Y) AS SUM_Y,
MAX(Z) AS MAX_Z
Resident T1
WHERE MATCH(W, 'AAA','BBB','CCC')
GROUP BY X;
This should improve the performance
 dafnis14
		
			dafnis14
		
		
		
		
		
		
		
		
	
			
		
		
			
					
		Amazing!
It took less then 5 minutes!
Thanks so much!
 
					
				
		
 sasiparupudi1
		
			sasiparupudi1
		
		
		
		
		
		
		
		
	
			
		
		
			
					
		Great, all the best
