Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello,
I'm attaching my qvw file which consists of script code. When i'm executing this code it Shows the error message as "Execution of script failed.Reload old data". The qvd file consists of 6 crores lines of data but when i execute same code with less amount of data it works fine. Can any one help me on this.
Hi, Jacq.
Your qvw is blank (without script too).
Can you post it again or include the script in a post?
Regards,
Erich
Script is in the second tab
Yes... I'm sorry...
Did you get any out of memory message?
You said it works if there is less lines. Does it work if you make less calculations on the left join?
What happens if you try this:
RTQMainData:
LOAD *
FROM
[..\2_QvdGenerator\QVD\RTQMainData1.qvd]
(qvd);
temp:
LOAD
LensKey,
DefectName,
if(DefectName ='Lens.Missing',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as MissingLens,
if(DefectName ='Defect.EdgeChip',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status EdgeChips],
if(DefectName ='Defect.EdgeTear',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status EdgeTear],
if(DefectName ='Defect.ExcessPiece.Flash',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status ExcessFlash],
if(DefectName ='Defect.ExcessPiece.ExcessPoly',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status ExcessPoly],
if(DefectName ='Defect.Bubble.Single',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status Bubbles],
if(DefectName ='Defect.Debris',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status Debris],
if(DefectName ='Defect.Hole',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status Hole],
if(DefectName ='Defect.SurfaceTear.Standard',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status SurfaceTears],
if(DefectName ='Defect.FM',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status FM],
if(DefectName ='Defect.Debris',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfDebrisFail ,
if(DefectName ='Defect.Debris',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfDebrisPass,
if(DefectName ='Defect.EdgeChip',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfEdgeChipFail ,
if(DefectName ='Defect.EdgeChip',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfEdgeChipPass,
if(DefectName ='Defect.EdgeTear',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfEdgeTearFail ,
if(DefectName ='Defect.EdgeTear',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfEdgeTearPass,
if(DefectName ='Defect.ExcessPiece.Flash',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfExcessPieceFlashFail ,
if(DefectName ='Defect.ExcessPiece.Flash',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfExcessPieceFlashPass,
if(DefectName ='Defect.ExcessPiece.ExcessPoly',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfExcessPieceExcessPolyFail ,
if(DefectName ='Defect.ExcessPiece.ExcessPoly',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfExcessPieceExcessPolyPass,
if(DefectName ='Defect.Bubble.Single',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfBubbleSingleFail ,
if(DefectName ='Defect.Bubble.Single',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfBubbleSinglePass,
if(DefectName ='Defect.Hole',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfHoleFail ,
if(DefectName ='Defect.Hole',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfHolePass,
if(DefectName ='Defect.SurfaceTear.Standard',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfSurfaceTearFail ,
if(DefectName ='Defect.SurfaceTear.Standard',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfSurfaceTearPass,
if(DefectName ='Defect.FM',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfFMFail ,
if(DefectName ='Defect.FM',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfFMPass,
COUNT(DebrisArea) as CountDebrisArea,
Min(DebrisArea) as MinDebrisArea,
Max(DebrisArea) as MaxDebrisArea,
Avg(DebrisArea) as AvgDebrisArea,
COUNT(DebrisAcircularity) as CountDebrisAcircularity,
Min(DebrisAcircularity) as MinDebrisAcircularity,
Max(DebrisAcircularity) as MaxDebrisAcircularity,
Avg(DebrisAcircularity) as AvgDebrisAcircularity,
COUNT(DebrisContrast) as CountDebrisContrast,
Min(DebrisContrast) as MinDebrisContrast,
Max(DebrisContrast) as MaxDebrisContrast,
Avg(DebrisContrast) as AvgDebrisContrast,
COUNT(DebrisElongation) as CountDebrisElongation,
Min(DebrisElongation) as MinDebrisElongation,
Max(DebrisElongation) as MaxDebrisElongation,
Avg(DebrisElongation) as AvgDebrisElongation,
COUNT(DebrisGradient) as CountDebrisGradient,
Min(DebrisGradient) as MinDebrisGradient,
Max(DebrisGradient) as MaxDebrisGradient,
Avg(DebrisGradient) as AvgDebrisGradient,
COUNT(DebrisLength) as CountDebrisLength,
Min(DebrisLength) as MinDebrisLength,
Max(DebrisLength) as MaxDebrisLength,
Avg(DebrisLength) as AvgDebrisLength,
COUNT(DebrisSharpness) as CountDebrisSharpness,
Min(DebrisSharpness) as MinDebrisSharpness,
Max(DebrisSharpness) as MaxDebrisSharpness,
Avg(DebrisSharpness) as AvgDebrisSharpness,
COUNT(DebrisWidth) as CountDebrisWidth,
Min(DebrisWidth) as MinDebrisWidth,
Max(DebrisWidth) as MaxDebrisWidth,
Avg(DebrisWidth) as AvgDebrisWidth,
COUNT(BubbleAcircularity) as CountBubbleAcircularity,
Min(BubbleAcircularity) as MinBubbleAcircularity,
Max(BubbleAcircularity) as MaxBubbleAcircularity,
Avg(BubbleAcircularity) as AvgBubbleAcircularity,
COUNT(BubbleArea) as CountBubbleArea,
Min(BubbleArea) as MinBubbleArea,
Max(BubbleArea) as MaxBubbleArea,
Avg(BubbleArea) as AvgBubbleArea,
COUNT(BubbleContrast) as CountBubbleContrast,
Min(BubbleContrast) as MinBubbleContrast,
Max(BubbleContrast) as MaxBubbleContrast,
Avg(BubbleContrast) as AvgBubbleContrast,
COUNT(BubbleElongation) as CountBubbleElongation,
Min(BubbleElongation) as MinBubbleElongation,
Max(BubbleElongation) as MaxBubbleElongation,
Avg(BubbleElongation) as AvgBubbleElongation,
COUNT(BubbleGradient) as CountBubbleGradient,
Min(BubbleGradient) as MinBubbleGradient,
Max(BubbleGradient) as MaxBubbleGradient,
Avg(BubbleGradient) as AvgBubbleGradient,
COUNT(BubbleSharpness) as CountBubbleSharpness,
Min(BubbleSharpness) as MinBubbleSharpness,
Max(BubbleSharpness) as MaxBubbleSharpness,
Avg(BubbleSharpness) as AvgBubbleSharpness,
COUNT(EdgeChipAngularLength) as CountEdgeChipAngularLength,
Min(EdgeChipAngularLength) as MinEdgeChipAngularLength,
Max(EdgeChipAngularLength) as MaxEdgeChipAngularLength,
Avg(EdgeChipAngularLength) as AvgEdgeChipAngularLength,
COUNT(EdgeChipRadialDepth) as CountEdgeChipRadialDepth,
Min(EdgeChipRadialDepth) as MinEdgeChipRadialDepth,
Max(EdgeChipRadialDepth) as MaxEdgeChipRadialDepth,
Avg(EdgeChipRadialDepth) as AvgEdgeChipRadialDepth,
COUNT(EdgeTearAngleFromTangent) as CountEdgeTearAngleFromTangent,
Min(EdgeTearAngleFromTangent) as MinEdgeTearAngleFromTangent,
Max(EdgeTearAngleFromTangent) as MaxEdgeTearAngleFromTangent,
Avg(EdgeTearAngleFromTangent) as AvgEdgeTearAngleFromTangent,
COUNT(EdgeTearArea) as CountEdgeTearArea,
Min(EdgeTearArea) as MinEdgeTearArea,
Max(EdgeTearArea) as MaxEdgeTearArea,
Avg(EdgeTearArea) as AvgEdgeTearArea,
COUNT(EdgeTearLength) as CountEdgeTearLength,
Min(EdgeTearLength) as MinEdgeTearLength,
Max(EdgeTearLength) as MaxEdgeTearLength,
Avg(EdgeTearLength) as AvgEdgeTearLength,
COUNT(EdgeTearWidth) as CountEdgeTearWidth,
Min(EdgeTearWidth) as MinEdgeTearWidth,
Max(EdgeTearWidth) as MaxEdgeTearWidth,
Avg(EdgeTearWidth) as AvgEdgeTearWidth,
COUNT(ExcessFlashAngularLength) as CountExcessFlashAngularLength,
Min(ExcessFlashAngularLength) as MinExcessFlashAngularLength,
Max(ExcessFlashAngularLength) as MaxExcessFlashAngularLength,
Avg(ExcessFlashAngularLength) as AvgExcessFlashAngularLength,
COUNT(ExcessFlashArea) as CountExcessFlashArea,
Min(ExcessFlashArea) as MinExcessFlashArea,
Max(ExcessFlashArea) as MaxExcessFlashArea,
Avg(ExcessFlashArea) as AvgExcessFlashArea,
COUNT(ExcessFlashContrast) as CountExcessFlashContrast,
Min(ExcessFlashContrast) as MinExcessFlashContrast,
Max(ExcessFlashContrast) as MaxExcessFlashContrast,
Avg(ExcessFlashContrast) as AvgExcessFlashContrast,
COUNT(ExcessFlashDistanceToLensEdge) as CountExcessFlashDistanceToLensEdge,
Min(ExcessFlashDistanceToLensEdge) as MinExcessFlashDistanceToLensEdge,
Max(ExcessFlashDistanceToLensEdge) as MaxExcessFlashDistanceToLensEdge,
Avg(ExcessFlashDistanceToLensEdge) as AvgExcessFlashDistanceToLensEdge,
COUNT(ExcessFlashGradient) as CountExcessFlashGradient,
Min(ExcessFlashGradient) as MinExcessFlashGradient,
Max(ExcessFlashGradient) as MaxExcessFlashGradient,
Avg(ExcessFlashGradient) as AvgExcessFlashGradient,
COUNT(ExcessFlashRadialHeight) as CountExcessFlashRadialHeight,
Min(ExcessFlashRadialHeight) as MinExcessFlashRadialHeight,
Max(ExcessFlashRadialHeight) as MaxExcessFlashRadialHeight,
Avg(ExcessFlashRadialHeight) as AvgExcessFlashRadialHeight,
COUNT(ExcessFlashSharpness) as CountExcessFlashSharpness,
Min(ExcessFlashSharpness) as MinExcessFlashSharpness,
Max(ExcessFlashSharpness) as MaxExcessFlashSharpness,
Avg(ExcessFlashSharpness) as AvgExcessFlashSharpness,
COUNT(ExcessPolyArea) as CountExcessPolyArea,
Min(ExcessPolyArea) as MinExcessPolyArea,
Max(ExcessPolyArea) as MaxExcessPolyArea,
Avg(ExcessPolyArea) as AvgExcessPolyArea,
COUNT(ExcessPolyContrast) as CountExcessPolyContrast,
Min(ExcessPolyContrast) as MinExcessPolyContrast,
Max(ExcessPolyContrast) as MaxExcessPolyContrast,
Avg(ExcessPolyContrast) as AvgExcessPolyContrast,
COUNT(ExcessPolyDistanceToLensEdge) as CountExcessPolyDistanceToLensEdge,
Min(ExcessPolyDistanceToLensEdge) as MinExcessPolyDistanceToLensEdge,
Max(ExcessPolyDistanceToLensEdge) as MaxExcessPolyDistanceToLensEdge,
Avg(ExcessPolyDistanceToLensEdge) as AvgExcessPolyDistanceToLensEdge,
COUNT(ExcessPolyElongation) as CountExcessPolyElongation,
Min(ExcessPolyElongation) as MinExcessPolyElongation,
Max(ExcessPolyElongation) as MaxExcessPolyElongation,
Avg(ExcessPolyElongation) as AvgExcessPolyElongation,
COUNT(ExcessPolyGradient) as CountExcessPolyGradient,
Min(ExcessPolyGradient) as MinExcessPolyGradient,
Max(ExcessPolyGradient) as MaxExcessPolyGradient,
Avg(ExcessPolyGradient) as AvgExcessPolyGradient,
COUNT(ExcessPolyLength) as CountExcessPolyLength,
Min(ExcessPolyLength) as MinExcessPolyLength,
Max(ExcessPolyLength) as MaxExcessPolyLength,
Avg(ExcessPolyLength) as AvgExcessPolyLength,
COUNT(ExcessPolySharpness) as CountExcessPolySharpness,
Min(ExcessPolySharpness) as MinExcessPolySharpness,
Max(ExcessPolySharpness) as MaxExcessPolySharpness,
Avg(ExcessPolySharpness) as AvgExcessPolySharpness,
COUNT(ExcessPolyWidth) as CountExcessPolyWidth,
Min(ExcessPolyWidth) as MinExcessPolyWidth,
Max(ExcessPolyWidth) as MaxExcessPolyWidth,
Avg(ExcessPolyWidth) as AvgExcessPolyWidth,
COUNT(HoleAcircularity) as CountHoleAcircularity,
Min(HoleAcircularity) as MinHoleAcircularity,
Max(HoleAcircularity) as MaxHoleAcircularity,
Avg(HoleAcircularity) as AvgHoleAcircularity,
COUNT(HoleArea) as CountHoleArea,
Min(HoleArea) as MinHoleArea,
Max(HoleArea) as MaxHoleArea,
Avg(HoleArea) as AvgHoleArea,
COUNT(HoleContrast) as CountHoleContrast,
Min(HoleContrast) as MinHoleContrast,
Max(HoleContrast) as MaxHoleContrast,
Avg(HoleContrast) as AvgHoleContrast,
COUNT(HoleElongation) as CountHoleElongation,
Min(HoleElongation) as MinHoleElongation,
Max(HoleElongation) as MaxHoleElongation,
Avg(HoleElongation) as AvgHoleElongation,
COUNT(HoleIsInsidePuddle) as CountHoleIsInsidePuddle,
Min(HoleIsInsidePuddle) as MinHoleIsInsidePuddle,
Max(HoleIsInsidePuddle) as MaxHoleIsInsidePuddle,
Avg(HoleIsInsidePuddle) as AvgHoleIsInsidePuddle,
COUNT(HoleIsUVBrightInside) as CountHoleIsUVBrightInside,
Min(HoleIsUVBrightInside) as MinHoleIsUVBrightInside,
Max(HoleIsUVBrightInside) as MaxHoleIsUVBrightInside,
Avg(HoleIsUVBrightInside) as AvgHoleIsUVBrightInside,
COUNT(HoleSharpness) as CountHoleSharpness,
Min(HoleSharpness) as MinHoleSharpness,
Max(HoleSharpness) as MaxHoleSharpness,
Avg(HoleSharpness) as AvgHoleSharpness,
COUNT(HoleWallThicknessCombinedRatio) as CountHoleWallThicknessCombinedRatio,
Min(HoleWallThicknessCombinedRatio) as MinHoleWallThicknessCombinedRatio,
Max(HoleWallThicknessCombinedRatio) as MaxHoleWallThicknessCombinedRatio,
Avg(HoleWallThicknessCombinedRatio) as AvgHoleWallThicknessCombinedRatio,
COUNT(SurfaceTearAngleFromTangent) as CountSurfaceTearAngleFromTangent,
Min(SurfaceTearAngleFromTangent) as MinSurfaceTearAngleFromTangent,
Max(SurfaceTearAngleFromTangent) as MaxSurfaceTearAngleFromTangent,
Avg(SurfaceTearAngleFromTangent) as AvgSurfaceTearAngleFromTangent,
COUNT(SurfaceTearArea) as CountSurfaceTearArea,
Min(SurfaceTearArea) as MinSurfaceTearArea,
Max(SurfaceTearArea) as MaxSurfaceTearArea,
Avg(SurfaceTearArea) as AvgSurfaceTearArea,
COUNT(SurfaceTearContrast) as CountSurfaceTearContrast,
Min(SurfaceTearContrast) as MinSurfaceTearContrast,
Max(SurfaceTearContrast) as MaxSurfaceTearContrast,
Avg(SurfaceTearContrast) as AvgSurfaceTearContrast,
COUNT(SurfaceTearDistanceToLensEdge) as CountSurfaceTearDistanceToLensEdge,
Min(SurfaceTearDistanceToLensEdge) as MinSurfaceTearDistanceToLensEdge,
Max(SurfaceTearDistanceToLensEdge) as MaxSurfaceTearDistanceToLensEdge,
Avg(SurfaceTearDistanceToLensEdge) as AvgSurfaceTearDistanceToLensEdge,
COUNT(SurfaceTearElongation) as CountSurfaceTearElongation,
Min(SurfaceTearElongation) as MinSurfaceTearElongation,
Max(SurfaceTearElongation) as MaxSurfaceTearElongation,
Avg(SurfaceTearElongation) as AvgSurfaceTearElongation,
COUNT(SurfaceTearLength) as CountSurfaceTearLength,
Min(SurfaceTearLength) as MinSurfaceTearLength,
Max(SurfaceTearLength) as MaxSurfaceTearLength,
Avg(SurfaceTearLength) as AvgSurfaceTearLength,
COUNT(SurfaceTearWidth) as CountSurfaceTearWidth,
Min(SurfaceTearWidth) as MinSurfaceTearWidth,
Max(SurfaceTearWidth) as MaxSurfaceTearWidth,
Avg(SurfaceTearWidth) as AvgSurfaceTearWidth
Resident RTQMainData
Group By
LensKey,
DefectName;
left join (RTQMainData)
Load * resident temp;
drop table temp;
What happens when you type:
Exit Script;
in line 6 and then load again?
This to see in which part of your loading script the error is.
Sorry for the late...
Ya i had tried as per ur suggestions but still there is a problem. After long period testing i realize that due insufficient of memory. I'm using 8GB ram and when i execute this file the performance moniter shows nearly 7.80 GB usage.
So i start my work by reducing the qvd file and then generate the summarized data. At last i'll concatinate all summarized data files.
This is my plan is there any suggestion on this plan. Please help me if you have any idea on this.
Hi jacq,
I've only detected a slight error, pls to see image attached
Also you say that I would use SUB/CALL and would not use JOIN for simplicity
Good luck, Luis