topic Re: Task Failed : application log interrupted but not error --- works perfectly with desktop in QlikView

Task Failed : application log interrupted but not error --- works perfectly with desktop

mohamed_ahid — Tue, 29 Mar 2016 08:35:55 GMT

Hi every body ,

i have an issue with an application which works perfectly with desktop version ,but fail every time on server after exactly 6h20s .

the application log shows no error and seems interrupted in the end :

15/03/2016 23:26:27: 1298 NEXT

15/03/2016 23:26:27: 1176 PRLVMT_RUN_AGGR:

15/03/2016 23:26:27: 1177 LOAD

15/03/2016 23:26:27: 1178 Numero_Facture,

15/03/2016 23:26:27: 1179 ReqdColltnDt,

15/03/2016 23:26:27: 1180 [Borne inférieure (inclusive)],

15/03/2016 23:26:27: 1181 [Borne supérieure Calculée (exclusive)],

15/03/2016 23:26:27: 1182 InstdAmt,

15/03/2016 23:26:27: 1183 CdtrAcctIDIBAN,

15/03/2016 23:26:27: 1184 GrpHdrCtrlSum,

15/03/2016 23:26:27: 1185 BIC,

15/03/2016 23:26:27: 1186 CdtrAcctIDIBANCountry,

15/03/2016 23:26:27: 1187 CdtrAcctIDIBANCodeBanque,

15/03/2016 23:26:27: 1188 CdtrAcctIDIBANCodeGuichet,

15/03/2016 23:26:27: 1189 EndToEndId,

15/03/2016 23:26:27: 1190 MndtId,

15/03/2016 23:26:27: 1191 SeqTp,

15/03/2016 23:26:27: 1192 DbtrAcctIBAN,

15/03/2016 23:26:27: 1193 DbtrAcctIBANCountry,

15/03/2016 23:26:27: 1194 DbtrAcctIBANCodeBanque,

15/03/2016 23:26:27: 1195 DbtrAcctIBANCodeGuichet,

15/03/2016 23:26:27: 1196 CreDtTm,

15/03/2016 23:26:27: 1197 Filename,

15/03/2016 23:26:27: 1198 PRLV.Compteur,

15/03/2016 23:26:27: 1199 BU,

15/03/2016 23:26:27: 1200 ID.Tranche,

15/03/2016 23:26:27: 1201 PMT_REQ_SENT_COUNTER

15/03/2016 23:26:27: 1202 FROM

15/03/2016 23:26:27: 1203 'E:\QLIKVIEW_WORKSPACE\DGCC\DGCC\Data\Work\SDD\PRLVMT_RUN_NA0E6102.0291.SEPADD.0533.1601012318.CSV.qvd' (qvd)

15/03/2016 23:26:27: 1204 Where

15/03/2016 23:26:27: 1205 PMT_REQ_SENT_COUNTER = '2'

15/03/2016 23:26:27: 1206 OR

15/03/2016 23:26:27: 1207 (

15/03/2016 23:26:27: 1208 (

15/03/2016 23:26:27: 1209 PMT_REQ_SENT_COUNTER = '1'

15/03/2016 23:26:27: 1210 OR

15/03/2016 23:26:27: 1211 ISNULL(PMT_REQ_SENT_COUNTER)

15/03/2016 23:26:27: 1212 )

15/03/2016 23:26:27: 1213 AND

15/03/2016 23:26:27: 1214 Exists (EndToEndId_REJ,EndToEndId)

15/03/2016 23:26:27: 1215 )

15/03/2016 23:26:27: 1216

15/03/2016 23:26:27: 24 fields found: Numero_Facture, ReqdColltnDt, Borne inférieure (inclusive), Borne supérieure Calculée (exclusive), InstdAmt, CdtrAcctIDIBAN, GrpHdrCtrlSum, BIC, CdtrAcctIDIBANCountry, CdtrAcctIDIBANCodeBanque, CdtrAcctIDIBANCodeGuichet, EndToEndId, MndtId, SeqTp, DbtrAcctIBAN, DbtrAcctIBANCountry, DbtrAcctIBANCodeBanque, DbtrAcctIBANCodeGuichet, CreDtTm, Filename, PRLV.Compteur, BU, ID.Tranche,

the qvs log generated looks like this (attached file)

any help .

thx

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

awhitfield — Tue, 29 Mar 2016 08:59:06 GMT

You have hit the default time out set against the reload on the document 21600 seconds, maybe your data source was unavailable at the time the reload was run, e.g. a Database backup.

HTH

Andy

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

mohamed_ahid — Tue, 29 Mar 2016 09:09:10 GMT

Thank you Andrew,

but my source is a simple QVD file wich is used only by this application .

i didn't get your point about the time out ? should i change it ? how ?

thx .

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

martinpohl — Tue, 29 Mar 2016 09:20:55 GMT

check your task

without publisher it might be looks different, but the option is the same

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

avinashelite — Tue, 29 Mar 2016 10:48:01 GMT

Could you please share the complete log file ?? that will be helpful for us to identify the problem

log file will in the source file location with the .log extension in the hidden format

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

awhitfield — Tue, 29 Mar 2016 11:19:51 GMT

OK, basically the load has timed out after 6 hours, the reload limit that I indicated. Has the Distribution Service Login User got read access permissions on the source file?

Andy

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

Peter_Cammaert — Tue, 29 Mar 2016 11:38:28 GMT

The statement that you posted is not the culprit. That last LOAD is just the unlucky one, getting executed at the time the QDS is considering to terminate your task because of taking too long to execute (1440 minutes=1 day with a publisher license, or 21600 seconds = 6 hours without a publisher license)

I see that you're using a loop in your script (terminated by the NEXT at the top of your script example). 6 hours is awfully long for a reload without a publisher. Can you figure out which part of your script is taking a long time to reload (the loop statement - either a DO or a FOR or a WHILE - is a prime candidate). Can you replace that one with a more efficient statement?

If not, increase the script timeout value at the bottom of the reload tab:

Best,

Peter

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

mohamed_ahid — Tue, 29 Mar 2016 12:07:26 GMT

Here is .

Thank you .

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

mohamed_ahid — Tue, 29 Mar 2016 12:12:29 GMT

it seems logical as you said 21600 = 6h .i have doubled this value and re launch the task .it's running right now .

and yes user got all necessary access to folders .

thx

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

mohamed_ahid — Tue, 29 Mar 2016 12:15:48 GMT

i have uploaded the log file .

i'm using "For Each file in FileList('..\Data\Work\SDD\PRLVMT_RUN*.qvd')" for looping .is there a way to make it faster /better ?

(this is one of my aims on this application is to improbe the load time actually 20 H more than 30go of QVD files )

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

Peter_Cammaert — Tue, 29 Mar 2016 14:17:15 GMT

There are at least two FOR loops that take a lot of time to complete, probably because of the large number of files the script is processing. My first suggestion would be to move each loop to a separate document, and run both in parallel. With a publisher license, tasks could be programmed quite nicely to run in parallel and continue with the next data stage when those two documents have both finished reloading. Without Publisher, you may have to figure out which one is taking more time at all times, and let that one initiate the next step.

Other suggestions:

do all processing in memory. Doing various table manipulations while reading from text files, pulls down your reload speed. You may need to check on the amount of RAM in your QV server..
try to categorize and throw together all file data into few QVD's. QVDs load many orders of a magnitude faster than an xml or csv file. Again you can use separate QVW documents to consolidate all text files before you start doing filtering and aggregation in your current QVW.
Do not load column data that you will never use.

Peter

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

mohamed_ahid — Tue, 29 Mar 2016 14:30:53 GMT

Thank you Peter for all these recommandations.

i appreciate .

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

mohamed_ahid — Wed, 30 Mar 2016 08:10:48 GMT

i have modified the task timeout to 172800, the task hase finished with failed statut on qmc but in log i see no error and load finished properly .

now it's juste a distibution server probleme .

any help ?

thx

Re: Task Failed : application log interrupted but not error --- works perfectly with desktop

Peter_Cammaert — Thu, 31 Mar 2016 09:22:22 GMT

Check the TaskLog. The TaskLog information can be found in two places:

In QMC->Status->Tasks, select the task you will be investigating, click "Show Task Details" (top right corner), select the failed reload time in the listbox on tab "Log" and check the end of the log details.
On your server, open Windows Explorer and navigate to C:\ProgramData\QlikTech\DistributionService\1\Log\. Select the directory with the correct date and open the subdirectory with the timestamp and name of the failed task. There should be a file called TaskLog.txt. Open it.

If you want further feedback, post the contents of that TaskLog in this thread.

Best,

Peter