Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi,
I have a script similar syntax to the following. After upgrade, it takes 2:15 hours instead of 30 minutes..
LOAD X,
SUM(Y) AS SUM_Y,
MAX(Z) AS MAX_Z
FROM c:\XXX
WHERE MATCH(W, 'AAA','BBB','CCC')
GROUP BY X;
Looks like the combination of the aggregation with the Match causes this.
Any idea why?
Thanks!
Message was edited by: Dafnis X Fixed the Group By clause
Hi Dafnis
Are you loading the data from a qvd? if this is the case, your group by and match will loose the optimization.
I would suggest you load the table in memory and then do the aggregation
ex:
t1:
LOAD X,
Y
Z
FROM c:\XXX;
T2:
LOAD X,
SUM(Y) AS SUM_Y,
MAX(Z) AS MAX_Z
Resident T1
WHERE MATCH(W, 'AAA','BBB','CCC')
GROUP BY X;
This should improve the performance
you can try like
WHERE W like 'AAA','BBB','CCC';
LOAD X,D
SUM(Y) AS SUM_Y,
MAX(Z) AS MAX_Z
FROM c:\XXX
WHERE MATCH(W, 'AAA','BBB','CCC')
GROUP BY X,D;
Hi Sasidhar,
The original script is correct.
Just fixed my example to the correct syntax.
Another words, there is probably some performance issue with the Group By and Match.
Thanks!
Hi Dafnis
Are you loading the data from a qvd? if this is the case, your group by and match will loose the optimization.
I would suggest you load the table in memory and then do the aggregation
ex:
t1:
LOAD X,
Y
Z
FROM c:\XXX;
T2:
LOAD X,
SUM(Y) AS SUM_Y,
MAX(Z) AS MAX_Z
Resident T1
WHERE MATCH(W, 'AAA','BBB','CCC')
GROUP BY X;
This should improve the performance
Amazing!
It took less then 5 minutes!
Thanks so much!
Great, all the best