topic Re: BATCH Reload : General Script Error in QlikView

BATCH Reload : General Script Error

Mon, 04 Jul 2016 12:55:08 GMT

Hello,

I am working at the IT Dept.

I am new in Qlikview and I dont know how to use Qlikview ^^ but I am charged to manage the reloads.

For that, I have created a BATCH Script that launches a reload.

Script


QVDistributionService.exe -r="D:\Qlikview\QVD\QVD.qvw" -out="D:\LOGS\QVD.log" QVDistributionService.exe -r="D:\Qlikview\MODELS\MODEL.qvw" -out="D:\LOGS\MODEL.log" QVDistributionService.exe -r="D:\Qlikview\APPS\Qlikview_Experimantal.qvw" -out="D:\LOGS\APPS.log"

QVDistributionService.exe -r="D:\Qlikview\QVD\QVD.qvw" -out="D:\LOGS\QVD.log"

QVDistributionService.exe -r="D:\Qlikview\MODELS\MODEL.qvw" -out="D:\LOGS\MODEL.log"

QVDistributionService.exe -r="D:\Qlikview\APPS\Qlikview_Experimantal.qvw" -out="D:\LOGS\APPS.log"

WhenI run that script from Task Scheduler, I got some errors like this :

Header 1
04/07/2016 12:37:11 Information REQUEST_NAME, 8Â 257Â 959 lines fetched 04/07/2016 12:38:14 Information 04/07/2016 12:36:29: 0511 DROP Table REQUEST 04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0536 MAP_NEWREQ: 04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0537 04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0538 mapping LOAD REQUEST_TYPE, 04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0539 REQUEST_TYPE_COUNT 04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0540 Resident REQUEST_TYPE 04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 2 fields found: TYPE_REQUEST, COMPTEUR_TYPE_REQUEST, 84 lines fetched 04/07/2016 12:42:55 Information 04/07/2016 12:38:02: 0547 COUNT LINE_PER_REQUEST: 04/07/2016 12:43:01 Information 04/07/2016 12:38:02: 0548 NoConcatenate 04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0549 LOAD REQUEST_NUMBER&ExtractionDate as LineNbr,count(REQUEST_NUMBER&ExtractionDate) as LINE_PER_REQUEST 04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0550 Resident TMP_REQUEST_DETAIL 04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0551 04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0552 04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0553 04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0554 04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0555 Group by REQUEST_NUMBER&ExtractionDate 04/07/2016 12:43:02 Information 04/07/2016 12:42:51: General Script Error 04/07/2016 12:43:59 Information 04/07/2016 12:42:57: Execution Failed 04/07/2016 12:43:59 Information 04/07/2016 12:43:59: Execution finished. 04/07/2016 12:44:14 Information The Source Document reload complete. DocumentPath=D:\Qlikview\MODELS\MODEL.qvw 04/07/2016 12:44:28 Information Memory Allocation Delta for this file=-686.35 Mb. Available Physical Memory Before Reload=10901.50 Mb. Available Physical Memory After Reload=11850.75 Mb. Total Physical Memory=11850.75 Mb. 04/07/2016 12:46:01 Error The Source Document was NOT reloaded successfully. DocumentPath=D:\Qlikview\MODELS\MODEL.qvw. 04/07/2016 12:46:13 Information Closing the document. 04/07/2016 12:46:14 Information Closed the QlikView Engine successfully. ProcessID=3832 04/07/2016 12:46:14 Error The Batch Job failed. ErrorCount=1 04/07/2016 12:46:14 Information Setting exit code to the number of errors. ErrorCount=2

Header 1

04/07/2016 12:37:11 Information REQUEST_NAME, 8Â 257Â 959 lines fetched

04/07/2016 12:38:14 Information 04/07/2016 12:36:29: 0511 DROP Table REQUEST

04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0536 MAP_NEWREQ:

04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0537

04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0538 mapping LOAD REQUEST_TYPE,

04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0539 REQUEST_TYPE_COUNT

04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 0540 Resident REQUEST_TYPE

04/07/2016 12:38:14 Information 04/07/2016 12:38:02: 2 fields found: TYPE_REQUEST, COMPTEUR_TYPE_REQUEST, 84 lines fetched

04/07/2016 12:42:55 Information 04/07/2016 12:38:02: 0547 COUNT LINE_PER_REQUEST:

04/07/2016 12:43:01 Information 04/07/2016 12:38:02: 0548 NoConcatenate

04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0549 LOAD REQUEST_NUMBER&ExtractionDate as LineNbr,count(REQUEST_NUMBER&ExtractionDate) as LINE_PER_REQUEST

04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0550 Resident TMP_REQUEST_DETAIL

04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0551

04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0552

04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0553

04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0554

04/07/2016 12:43:02 Information 04/07/2016 12:38:02: 0555 Group by REQUEST_NUMBER&ExtractionDate

04/07/2016 12:43:02 Information 04/07/2016 12:42:51: General Script Error

04/07/2016 12:43:59 Information 04/07/2016 12:42:57: Execution Failed

04/07/2016 12:43:59 Information 04/07/2016 12:43:59: Execution finished.

04/07/2016 12:44:14 Information The Source Document reload complete. DocumentPath=D:\Qlikview\MODELS\MODEL.qvw

04/07/2016 12:44:28 Information Memory Allocation Delta for this file=-686.35 Mb. Available Physical Memory Before Reload=10901.50 Mb. Available Physical Memory After Reload=11850.75 Mb. Total Physical Memory=11850.75 Mb.

04/07/2016 12:46:01 Error The Source Document was NOT reloaded successfully. DocumentPath=D:\Qlikview\MODELS\MODEL.qvw.

04/07/2016 12:46:13 Information Closing the document.

04/07/2016 12:46:14 Information Closed the QlikView Engine successfully. ProcessID=3832

04/07/2016 12:46:14 Error The Batch Job failed. ErrorCount=1

04/07/2016 12:46:14 Information Setting exit code to the number of errors. ErrorCount=2

If I reload the application from the Qlikview client (I mean open the QVW model file and clik on Reload button), the reload is OK.

After the manual reload, I can run successfully my batch file.

So, maybe I have forgotten something in my script ?

Whats wrong with that ?

Thank you for your help.

Re: BATCH Reload : General Script Error

marcus_sommer — Mon, 04 Jul 2016 13:14:25 GMT

This kind of failure happens quite often because the server services run with a different user which missed the proper access rights to certain files, databases and similar.

If not done yet I suggest to enable the script-log within the document properties of a qvw to see why the script-execution failed.

- Marcus

Re: BATCH Reload : General Script Error

Mon, 04 Jul 2016 13:19:11 GMT

Marcus

Thank you for the quick answer.

The scripts rans with the local administrator privileges. The services runs with a local Qlikview_user

Can you tell me how to enable the script log ? And where I can find the logs after the reload fails ?

Thank you

Re: BATCH Reload : General Script Error

Peter_Cammaert — Mon, 04 Jul 2016 13:38:26 GMT

Any particular reason why you are using Cmd files to simulate tasks, while you do seem to have a Distribution Engine at your disposal?

Re: BATCH Reload : General Script Error

Peter_Cammaert — Mon, 04 Jul 2016 13:44:12 GMT

Marcus is onto something (again ).

Karim, you say that if you reload the document in QV Desktop (thereby implying that you save after a reload), the batch file runs ok. That means that a desktop reload will set different permissions on the saved file, after which a QDS reload will be able to overwrite the saved document.

Apparently in the script log you posted, the QDS has problems saving either the temporary file or the end result. That is, if the GROUP BY statement is the last statement in your load script.

Peter

Re: BATCH Reload : General Script Error

Mon, 04 Jul 2016 13:52:13 GMT

Yes Peter, there is a reason.

Qlikview developpers cannot have access to the server. It is security / policital / stupid ? internal policy. Anyway, they cannot connect to run manually the reloads and this absolutely not possible to change that (even if I would like to) , but they need to reload the application when they want.

So, I have created the command file for the reload, so the developpers can just send a trigger file to the serveur to execute the script.

Re: BATCH Reload : General Script Error

Mon, 04 Jul 2016 13:59:48 GMT

Peter,

in order to do the same job as a manual reload; is there anything I could add or change in my batch script ?

Re: BATCH Reload : General Script Error

Peter_Cammaert — Mon, 04 Jul 2016 16:20:04 GMT

Two alternatives:

Make them Document Administrators
Add a trigger "on an external event" and provide your Developers with QMSEDX or any other tool that can remotely trigger task execution.

Peter

Re: BATCH Reload : General Script Error

Peter_Cammaert — Mon, 04 Jul 2016 16:21:17 GMT

Use runas to use the same credentials to reload the documents as the QDS uses.

Peter

Re: BATCH Reload : General Script Error

Mon, 04 Jul 2016 16:23:07 GMT

I will try that and let you know. It may take a week.

Re: BATCH Reload : General Script Error

Thu, 07 Jul 2016 11:58:34 GMT

Hi guys

Run as qlikview user sounds good.

I need more time to reproduce the real conditions (automatic process running once a week) but the manual tests look good.

I'll keep you update.

Re: BATCH Reload : General Script Error

Fri, 12 Aug 2016 06:36:55 GMT

Hi guys,

sorry for the delay. Running scripts AS the same user as Qlikview server works well.

Thank you for your help.