I'm attaching my qvw file which consists of script code. When i'm executing this code it Shows the error message as "Execution of script failed.Reload old data". The qvd file consists of 6 crores lines of data but when i execute same code with less amount of data it works fine. Can any one help me on this.
You said it works if there is less lines. Does it work if you make less calculations on the left join?
What happens if you try this:
RTQMainData:
LOAD *
FROM
[..\2_QvdGenerator\QVD\RTQMainData1.qvd]
(qvd);
temp:
LOAD
LensKey,
DefectName,
if(DefectName ='Lens.Missing',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as MissingLens,
if(DefectName ='Defect.EdgeChip',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status EdgeChips],
if(DefectName ='Defect.EdgeTear',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status EdgeTear],
if(DefectName ='Defect.ExcessPiece.Flash',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status ExcessFlash],
if(DefectName ='Defect.ExcessPiece.ExcessPoly',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status ExcessPoly],
if(DefectName ='Defect.Bubble.Single',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status Bubbles],
if(DefectName ='Defect.Debris',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status Debris],
if(DefectName ='Defect.Hole',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status Hole],
if(DefectName ='Defect.SurfaceTear.Standard',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status SurfaceTears],
if(DefectName ='Defect.FM',if(substringCount(Concat(DefectStatus,';'),'Fail')>0,'Fail',if(substringCount(Concat(DefectStatus,';'),'Pass')>0,'Pass','NA')),'Null') as [Status FM],
if(DefectName ='Defect.Debris',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfDebrisFail ,
if(DefectName ='Defect.Debris',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfDebrisPass,
if(DefectName ='Defect.EdgeChip',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfEdgeChipFail ,
if(DefectName ='Defect.EdgeChip',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfEdgeChipPass,
if(DefectName ='Defect.EdgeTear',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfEdgeTearFail ,
if(DefectName ='Defect.EdgeTear',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfEdgeTearPass,
if(DefectName ='Defect.ExcessPiece.Flash',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfExcessPieceFlashFail ,
if(DefectName ='Defect.ExcessPiece.Flash',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfExcessPieceFlashPass,
if(DefectName ='Defect.ExcessPiece.ExcessPoly',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfExcessPieceExcessPolyFail ,
if(DefectName ='Defect.ExcessPiece.ExcessPoly',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfExcessPieceExcessPolyPass,
if(DefectName ='Defect.Bubble.Single',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfBubbleSingleFail ,
if(DefectName ='Defect.Bubble.Single',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfBubbleSinglePass,
if(DefectName ='Defect.Hole',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfHoleFail ,
if(DefectName ='Defect.Hole',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfHolePass,
if(DefectName ='Defect.SurfaceTear.Standard',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfSurfaceTearFail ,
if(DefectName ='Defect.SurfaceTear.Standard',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfSurfaceTearPass,
if(DefectName ='Defect.FM',substringCount(Concat(DefectStatus,';'),'Fail'),0) as NumberOfFMFail ,
if(DefectName ='Defect.FM',substringCount(Concat(DefectStatus,';'),'Pass'),0) as NumberOfFMPass,
COUNT(DebrisArea) as CountDebrisArea,
Min(DebrisArea) as MinDebrisArea,
Max(DebrisArea) as MaxDebrisArea,
Avg(DebrisArea) as AvgDebrisArea,
COUNT(DebrisAcircularity) as CountDebrisAcircularity,
Min(DebrisAcircularity) as MinDebrisAcircularity,
Max(DebrisAcircularity) as MaxDebrisAcircularity,
Avg(DebrisAcircularity) as AvgDebrisAcircularity,
COUNT(DebrisContrast) as CountDebrisContrast,
Min(DebrisContrast) as MinDebrisContrast,
Max(DebrisContrast) as MaxDebrisContrast,
Avg(DebrisContrast) as AvgDebrisContrast,
COUNT(DebrisElongation) as CountDebrisElongation,
Min(DebrisElongation) as MinDebrisElongation,
Max(DebrisElongation) as MaxDebrisElongation,
Avg(DebrisElongation) as AvgDebrisElongation,
COUNT(DebrisGradient) as CountDebrisGradient,
Min(DebrisGradient) as MinDebrisGradient,
Max(DebrisGradient) as MaxDebrisGradient,
Avg(DebrisGradient) as AvgDebrisGradient,
COUNT(DebrisLength) as CountDebrisLength,
Min(DebrisLength) as MinDebrisLength,
Max(DebrisLength) as MaxDebrisLength,
Avg(DebrisLength) as AvgDebrisLength,
COUNT(DebrisSharpness) as CountDebrisSharpness,
Min(DebrisSharpness) as MinDebrisSharpness,
Max(DebrisSharpness) as MaxDebrisSharpness,
Avg(DebrisSharpness) as AvgDebrisSharpness,
COUNT(DebrisWidth) as CountDebrisWidth,
Min(DebrisWidth) as MinDebrisWidth,
Max(DebrisWidth) as MaxDebrisWidth,
Avg(DebrisWidth) as AvgDebrisWidth,
COUNT(BubbleAcircularity) as CountBubbleAcircularity,
Min(BubbleAcircularity) as MinBubbleAcircularity,
Max(BubbleAcircularity) as MaxBubbleAcircularity,
Avg(BubbleAcircularity) as AvgBubbleAcircularity,
COUNT(BubbleArea) as CountBubbleArea,
Min(BubbleArea) as MinBubbleArea,
Max(BubbleArea) as MaxBubbleArea,
Avg(BubbleArea) as AvgBubbleArea,
COUNT(BubbleContrast) as CountBubbleContrast,
Min(BubbleContrast) as MinBubbleContrast,
Max(BubbleContrast) as MaxBubbleContrast,
Avg(BubbleContrast) as AvgBubbleContrast,
COUNT(BubbleElongation) as CountBubbleElongation,
Min(BubbleElongation) as MinBubbleElongation,
Max(BubbleElongation) as MaxBubbleElongation,
Avg(BubbleElongation) as AvgBubbleElongation,
COUNT(BubbleGradient) as CountBubbleGradient,
Min(BubbleGradient) as MinBubbleGradient,
Max(BubbleGradient) as MaxBubbleGradient,
Avg(BubbleGradient) as AvgBubbleGradient,
COUNT(BubbleSharpness) as CountBubbleSharpness,
Min(BubbleSharpness) as MinBubbleSharpness,
Max(BubbleSharpness) as MaxBubbleSharpness,
Avg(BubbleSharpness) as AvgBubbleSharpness,
COUNT(EdgeChipAngularLength) as CountEdgeChipAngularLength,
Min(EdgeChipAngularLength) as MinEdgeChipAngularLength,
Max(EdgeChipAngularLength) as MaxEdgeChipAngularLength,
Avg(EdgeChipAngularLength) as AvgEdgeChipAngularLength,
COUNT(EdgeChipRadialDepth) as CountEdgeChipRadialDepth,
Min(EdgeChipRadialDepth) as MinEdgeChipRadialDepth,
Max(EdgeChipRadialDepth) as MaxEdgeChipRadialDepth,
Avg(EdgeChipRadialDepth) as AvgEdgeChipRadialDepth,
COUNT(EdgeTearAngleFromTangent) as CountEdgeTearAngleFromTangent,
Min(EdgeTearAngleFromTangent) as MinEdgeTearAngleFromTangent,
Max(EdgeTearAngleFromTangent) as MaxEdgeTearAngleFromTangent,
Avg(EdgeTearAngleFromTangent) as AvgEdgeTearAngleFromTangent,
COUNT(EdgeTearArea) as CountEdgeTearArea,
Min(EdgeTearArea) as MinEdgeTearArea,
Max(EdgeTearArea) as MaxEdgeTearArea,
Avg(EdgeTearArea) as AvgEdgeTearArea,
COUNT(EdgeTearLength) as CountEdgeTearLength,
Min(EdgeTearLength) as MinEdgeTearLength,
Max(EdgeTearLength) as MaxEdgeTearLength,
Avg(EdgeTearLength) as AvgEdgeTearLength,
COUNT(EdgeTearWidth) as CountEdgeTearWidth,
Min(EdgeTearWidth) as MinEdgeTearWidth,
Max(EdgeTearWidth) as MaxEdgeTearWidth,
Avg(EdgeTearWidth) as AvgEdgeTearWidth,
COUNT(ExcessFlashAngularLength) as CountExcessFlashAngularLength,
Min(ExcessFlashAngularLength) as MinExcessFlashAngularLength,
Max(ExcessFlashAngularLength) as MaxExcessFlashAngularLength,
Avg(ExcessFlashAngularLength) as AvgExcessFlashAngularLength,
COUNT(ExcessFlashArea) as CountExcessFlashArea,
Min(ExcessFlashArea) as MinExcessFlashArea,
Max(ExcessFlashArea) as MaxExcessFlashArea,
Avg(ExcessFlashArea) as AvgExcessFlashArea,
COUNT(ExcessFlashContrast) as CountExcessFlashContrast,
Min(ExcessFlashContrast) as MinExcessFlashContrast,
Max(ExcessFlashContrast) as MaxExcessFlashContrast,
Avg(ExcessFlashContrast) as AvgExcessFlashContrast,
COUNT(ExcessFlashDistanceToLensEdge) as CountExcessFlashDistanceToLensEdge,
Min(ExcessFlashDistanceToLensEdge) as MinExcessFlashDistanceToLensEdge,
Max(ExcessFlashDistanceToLensEdge) as MaxExcessFlashDistanceToLensEdge,
Avg(ExcessFlashDistanceToLensEdge) as AvgExcessFlashDistanceToLensEdge,
COUNT(ExcessFlashGradient) as CountExcessFlashGradient,
Min(ExcessFlashGradient) as MinExcessFlashGradient,
Max(ExcessFlashGradient) as MaxExcessFlashGradient,
Avg(ExcessFlashGradient) as AvgExcessFlashGradient,
COUNT(ExcessFlashRadialHeight) as CountExcessFlashRadialHeight,
Min(ExcessFlashRadialHeight) as MinExcessFlashRadialHeight,
Max(ExcessFlashRadialHeight) as MaxExcessFlashRadialHeight,
Avg(ExcessFlashRadialHeight) as AvgExcessFlashRadialHeight,
COUNT(ExcessFlashSharpness) as CountExcessFlashSharpness,
Min(ExcessFlashSharpness) as MinExcessFlashSharpness,
Max(ExcessFlashSharpness) as MaxExcessFlashSharpness,
Avg(ExcessFlashSharpness) as AvgExcessFlashSharpness,
COUNT(ExcessPolyArea) as CountExcessPolyArea,
Min(ExcessPolyArea) as MinExcessPolyArea,
Max(ExcessPolyArea) as MaxExcessPolyArea,
Avg(ExcessPolyArea) as AvgExcessPolyArea,
COUNT(ExcessPolyContrast) as CountExcessPolyContrast,
Min(ExcessPolyContrast) as MinExcessPolyContrast,
Max(ExcessPolyContrast) as MaxExcessPolyContrast,
Avg(ExcessPolyContrast) as AvgExcessPolyContrast,
COUNT(ExcessPolyDistanceToLensEdge) as CountExcessPolyDistanceToLensEdge,
Min(ExcessPolyDistanceToLensEdge) as MinExcessPolyDistanceToLensEdge,
Max(ExcessPolyDistanceToLensEdge) as MaxExcessPolyDistanceToLensEdge,
Avg(ExcessPolyDistanceToLensEdge) as AvgExcessPolyDistanceToLensEdge,
COUNT(ExcessPolyElongation) as CountExcessPolyElongation,
Min(ExcessPolyElongation) as MinExcessPolyElongation,
Max(ExcessPolyElongation) as MaxExcessPolyElongation,
Avg(ExcessPolyElongation) as AvgExcessPolyElongation,
COUNT(ExcessPolyGradient) as CountExcessPolyGradient,
Min(ExcessPolyGradient) as MinExcessPolyGradient,
Max(ExcessPolyGradient) as MaxExcessPolyGradient,
Avg(ExcessPolyGradient) as AvgExcessPolyGradient,
COUNT(ExcessPolyLength) as CountExcessPolyLength,
Min(ExcessPolyLength) as MinExcessPolyLength,
Max(ExcessPolyLength) as MaxExcessPolyLength,
Avg(ExcessPolyLength) as AvgExcessPolyLength,
COUNT(ExcessPolySharpness) as CountExcessPolySharpness,
Min(ExcessPolySharpness) as MinExcessPolySharpness,
Max(ExcessPolySharpness) as MaxExcessPolySharpness,
Avg(ExcessPolySharpness) as AvgExcessPolySharpness,
COUNT(ExcessPolyWidth) as CountExcessPolyWidth,
Min(ExcessPolyWidth) as MinExcessPolyWidth,
Max(ExcessPolyWidth) as MaxExcessPolyWidth,
Avg(ExcessPolyWidth) as AvgExcessPolyWidth,
COUNT(HoleAcircularity) as CountHoleAcircularity,
Min(HoleAcircularity) as MinHoleAcircularity,
Max(HoleAcircularity) as MaxHoleAcircularity,
Avg(HoleAcircularity) as AvgHoleAcircularity,
COUNT(HoleArea) as CountHoleArea,
Min(HoleArea) as MinHoleArea,
Max(HoleArea) as MaxHoleArea,
Avg(HoleArea) as AvgHoleArea,
COUNT(HoleContrast) as CountHoleContrast,
Min(HoleContrast) as MinHoleContrast,
Max(HoleContrast) as MaxHoleContrast,
Avg(HoleContrast) as AvgHoleContrast,
COUNT(HoleElongation) as CountHoleElongation,
Min(HoleElongation) as MinHoleElongation,
Max(HoleElongation) as MaxHoleElongation,
Avg(HoleElongation) as AvgHoleElongation,
COUNT(HoleIsInsidePuddle) as CountHoleIsInsidePuddle,
Min(HoleIsInsidePuddle) as MinHoleIsInsidePuddle,
Max(HoleIsInsidePuddle) as MaxHoleIsInsidePuddle,
Avg(HoleIsInsidePuddle) as AvgHoleIsInsidePuddle,
COUNT(HoleIsUVBrightInside) as CountHoleIsUVBrightInside,
Min(HoleIsUVBrightInside) as MinHoleIsUVBrightInside,
Max(HoleIsUVBrightInside) as MaxHoleIsUVBrightInside,
Avg(HoleIsUVBrightInside) as AvgHoleIsUVBrightInside,
COUNT(HoleSharpness) as CountHoleSharpness,
Min(HoleSharpness) as MinHoleSharpness,
Max(HoleSharpness) as MaxHoleSharpness,
Avg(HoleSharpness) as AvgHoleSharpness,
COUNT(HoleWallThicknessCombinedRatio) as CountHoleWallThicknessCombinedRatio,
Min(HoleWallThicknessCombinedRatio) as MinHoleWallThicknessCombinedRatio,
Max(HoleWallThicknessCombinedRatio) as MaxHoleWallThicknessCombinedRatio,
Avg(HoleWallThicknessCombinedRatio) as AvgHoleWallThicknessCombinedRatio,
COUNT(SurfaceTearAngleFromTangent) as CountSurfaceTearAngleFromTangent,
Min(SurfaceTearAngleFromTangent) as MinSurfaceTearAngleFromTangent,
Max(SurfaceTearAngleFromTangent) as MaxSurfaceTearAngleFromTangent,
Avg(SurfaceTearAngleFromTangent) as AvgSurfaceTearAngleFromTangent,
COUNT(SurfaceTearArea) as CountSurfaceTearArea,
Min(SurfaceTearArea) as MinSurfaceTearArea,
Max(SurfaceTearArea) as MaxSurfaceTearArea,
Avg(SurfaceTearArea) as AvgSurfaceTearArea,
COUNT(SurfaceTearContrast) as CountSurfaceTearContrast,
Min(SurfaceTearContrast) as MinSurfaceTearContrast,
Max(SurfaceTearContrast) as MaxSurfaceTearContrast,
Avg(SurfaceTearContrast) as AvgSurfaceTearContrast,
COUNT(SurfaceTearDistanceToLensEdge) as CountSurfaceTearDistanceToLensEdge,
Min(SurfaceTearDistanceToLensEdge) as MinSurfaceTearDistanceToLensEdge,
Max(SurfaceTearDistanceToLensEdge) as MaxSurfaceTearDistanceToLensEdge,
Avg(SurfaceTearDistanceToLensEdge) as AvgSurfaceTearDistanceToLensEdge,
COUNT(SurfaceTearElongation) as CountSurfaceTearElongation,
Min(SurfaceTearElongation) as MinSurfaceTearElongation,
Max(SurfaceTearElongation) as MaxSurfaceTearElongation,
Avg(SurfaceTearElongation) as AvgSurfaceTearElongation,
COUNT(SurfaceTearLength) as CountSurfaceTearLength,
Ya i had tried as per ur suggestions but still there is a problem. After long period testing i realize that due insufficient of memory. I'm using 8GB ram and when i execute this file the performance moniter shows nearly 7.80 GB usage.
So i start my work by reducing the qvd file and then generate the summarized data. At last i'll concatinate all summarized data files.
This is my plan is there any suggestion on this plan. Please help me if you have any idea on this.
