topic Re: general script error on store command in QlikView

general script error on store command

gerrycastellino — Fri, 12 Aug 2016 16:50:41 GMT

'General Script Error' being thrown on a store command from a section of code below

When I reduce the r

Record loads to 10M records for this assetdetail table it works fine.

On a full load - it has 31M records.

There are no other locks that I know on this table.

I have deleted and regenerated all QVD files.

Put in sleep(5000) statement, and SET ErrorMode=0;

This was work as of yesterday, not sure why all of a sudden this is now happening.

See also log files and qvw files.

/////////////////////////////////////////////////////////////////////////

LET vAudienceSizingTableName_TEMP	= 'AudienceSizing_TEMP';
LET vAudienceSizingTEMPQVD		= vBaseDir & 'QlikView_QVD\$(Folder)\$(QVDType)\$(Folder).$(QVDType).$(vAudienceSizingTableName_TEMP).qvd';

SET ErrorMode=0;

NoConcatenate

$(vAudienceSizingTableName_TEMP):

LOAD

%Record_Counter,

marketo_id_key,

sfdc_contact_id_key,

%marketo_id_key_Activity,

%email_key,

%sfdc_contact_id_key_AssetDetail

FROM [$(vAudienceSizingQVD)] (qvd);

Left Join

LOAD

%email_key,

reportclassification

FROM [$(vTauonlineuserQVD)] (qvd);

Left Join

LOAD

%marketo_id_key_Activity,

E_NewsletterEngagement,

ER2BH

FROM [$(vTactivityQVD)] (qvd);

Left Join

LOAD

marketo_id_key,

E_TrialEngagement

FROM [$(vTsupplementalusageQVD)] (qvd);

left Join

LOAD

%sfdc_contact_id_key_AssetDetail,

E_SubsEngagement

FROM [$(vTassetdetailQVD)] (qvd);

//error seems to be at this store syntax

//works fine if I limit record load to 10M (out of total of 32M) records from the assetdetail QVD file

sleep(5000);

store $(vAudienceSizingTableName_TEMP) into $(vAudienceSizingTEMPQVD);

sleep(5000);

DROP table $(vAudienceSizingTableName_TEMP);

Re: general script error on store command

Gysbert_Wassenaar — Fri, 12 Aug 2016 16:56:43 GMT

Make sure your machine isn't running out of memory or disk space.

Re: general script error on store command

gerrycastellino — Fri, 12 Aug 2016 17:04:11 GMT

I have plenty of disk space.

RAM usage is at 99% at time of failure.

It runs for about 10 minutes at the store statement and then fails.

Gerry.

Re: general script error on store command

Gysbert_Wassenaar — Fri, 12 Aug 2016 17:09:55 GMT

My guess is that you're running out of ram then. Try a machine with more ram. You could also try replacing the left joins with the use of mapping tables and the applymap function. Perhaps that has a positive effect on the amount of ram used.

Re: general script error on store command

gerrycastellino — Sat, 13 Aug 2016 02:55:21 GMT

Gysbert:

That approach seems to have worked !

Tell me where to send the box of chocolates !

Gerry.