QMC Task is not loaded successfully

[KishoreSuriF]

Hi All,

We have a problem to complete QlikView Task complete in QMC. We are getting the error as below (log file )

We followed the approaches found in Qlik Community related to the error , but we are failed to fix .

Someone from Qlik support team help us  to fix this issue.

(01/12/2023 12:50:16) Information: DistributeTask[90671fb9-60b9-4d8e-843c-5f1c2eb675bb] ("ETL02_TransactionAnalysis"): TryStart - Starting task. Triggered by 'ManualStartTrigger'. Id:00000001-0002-0003-0405-0607080a0b0c. ExecID:c8fa664f-4a6b-40ba-97c6-309fd52cbce6

(01/12/2023 12:50:16) Information: Entering Task Execution.

(01/12/2023 12:50:16) Information: ClusterID=1

(01/12/2023 12:50:16) Information: QDSID=75c55e01-c75e-7a05-9d66-3ef8b461d6b7

(01/12/2023 12:50:16) Information: TaskID=90671fb9-60b9-4d8e-843c-5f1c2eb675bb

(01/12/2023 12:50:16) Information: ExecID=c8fa664f-4a6b-40ba-97c6-309fd52cbce6

(01/12/2023 12:50:16) Information: MaxRunTime=1.00:00:00

(01/12/2023 12:50:16) Information: MachineName=vmneurqlkprd01

(01/12/2023 12:50:16) Information: Task execution max attempts=1

(01/12/2023 12:50:16) Information: Task execution current attempt=1

(01/12/2023 12:50:16) Information: Task Dependencies are OK

(01/12/2023 12:50:16) Information: The task "ETL02_TransactionAnalysis" is starting

(01/12/2023 12:50:16) Information: Document is marked to be Reloaded with fresh data. Initializing Reload for Distribution.

(01/12/2023 12:50:16) Information: Opening "D:\QvSourceDocs\ROOT\ETL02\ETL02_0_TransactionAnalysis.qvw"

(01/12/2023 12:50:16) Information: Allocating new QlikView Engine. Current usage count=1 of 4 (of type non-reader).

(01/12/2023 12:50:16) Information: Max retries:5

(01/12/2023 12:50:16) Information: Attempt:01

(01/12/2023 12:50:17) Information: Opened the QlikView Engine successfully. ProcessID=3608484

(01/12/2023 12:50:17) Information: Allocated QlikView Engine successfully. Current usage count=2 of 4 (of type non-reader). Ticket number=522.

(01/12/2023 12:50:17) Information: Loading document "D:\QvSourceDocs\ROOT\ETL02\ETL02_0_TransactionAnalysis.qvw" (0.27 Mb)

(01/12/2023 12:50:17) Information: Physical FileSize=0.27 Mb. Memory Allocation Delta for this file=8.55 Mb. Available Physical Memory Before Open=257295.61 Mb. Available Physical Memory After Open=257271.64 Mb. Total Physical Memory=393215.55 Mb.

(01/12/2023 12:50:17) Information: Attempted to load the document without data.

(01/12/2023 12:50:17) Information: The document was loaded successfully.

(01/12/2023 12:50:17) Information: Document was opened successfully

(01/12/2023 12:50:17) Information: Starting reload

(01/12/2023 12:50:17) Information: The Source Document is being reloaded. DocumentPath=D:\QvSourceDocs\ROOT\ETL02\ETL02_0_TransactionAnalysis.qvw

(01/12/2023 12:50:18) Information: Reloading.

(01/12/2023 12:50:19) Information: Reloading..

(01/12/2023 12:50:20) Information: Reloading...

(01/12/2023 12:50:21) Information: Reloading....

(01/12/2023 12:50:22) Information: Reloading.....

(01/12/2023 12:50:23) Information: Reloading......

(01/12/2023 12:50:24) Information: Reloading.......

(01/12/2023 12:50:25) Information: Reloading........

(01/12/2023 12:50:26) Information: Reloading.........

(01/12/2023 12:50:27) Information: Reloading..........

(01/12/2023 12:50:28) Information: Slow down logging. Log every <2> seconds.

(01/12/2023 12:50:28) Information: Reloading

(01/12/2023 12:50:30) Information: Reloading.

(01/12/2023 12:50:32) Information: Reloading..

(01/12/2023 12:50:34) Information: Reloading...

(01/12/2023 12:50:36) Information: Reloading....

(01/12/2023 12:50:38) Information: Reloading.....

(01/12/2023 12:50:40) Information: Reloading......

(01/12/2023 12:50:42) Information: Reloading.......

(01/12/2023 12:50:44) Information: Reloading........

(01/12/2023 12:50:46) Information: Reloading.........

(01/12/2023 12:50:48) Information: Reloading..........

(01/12/2023 12:50:50) Information: Slow down logging. Log every <10> seconds.

(01/12/2023 12:50:50) Information: Reloading

(01/12/2023 12:51:00) Information: Reloading.

(01/12/2023 12:51:11) Information: Reloading..

(01/12/2023 12:51:21) Information: Reloading...

(01/12/2023 12:51:31) Information: Reloading....

(01/12/2023 12:51:41) Information: Reloading.....

(01/12/2023 12:51:51) Information: Reloading......

(01/12/2023 12:52:01) Information: Reloading.......

(01/12/2023 12:52:11) Information: Reloading........

(01/12/2023 12:52:21) Information: Reloading.........

(01/12/2023 12:52:31) Information: Reloading..........

(01/12/2023 12:52:41) Information: Slow down logging. Log every <60> seconds.

(01/12/2023 12:52:41) Information: Reloading

(01/12/2023 12:53:41) Information: Reloading.

(01/12/2023 12:54:41) Information: Reloading..

(01/12/2023 12:55:41) Information: Reloading...

(01/12/2023 12:56:41) Information: Reloading....

(01/12/2023 12:57:42) Information: Reloading.....

(01/12/2023 12:58:42) Information: Reloading......

(01/12/2023 12:59:42) Information: Reloading.......

(01/12/2023 13:00:42) Information: Reloading........

(01/12/2023 13:01:42) Information: Reloading.........

(01/12/2023 13:02:42) Information: Reloading..........

(01/12/2023 13:03:42) Information: Slow down logging. Log every <300> seconds.

(01/12/2023 13:03:42) Information: Reloading

(01/12/2023 13:05:46) Information: The Source Document reload complete. DocumentPath=D:\QvSourceDocs\ROOT\ETL02\ETL02_0_TransactionAnalysis.qvw

(01/12/2023 13:05:46) Information: Memory Allocation Delta for this file=123.07 Mb. Available Physical Memory Before Reload=257268.32 Mb. Available Physical Memory After Reload=249236.41 Mb.

(01/12/2023 13:05:47) Error: The Source Document was NOT reloaded successfully. DocumentPath=D:\QvSourceDocs\ROOT\ETL02\ETL02_0_TransactionAnalysis.qvw.

(01/12/2023 13:05:47) Information: QlikView->Settings->Document Peferences->Generate Logfile in document is set. Enabling Log Copier.

(01/12/2023 13:05:47) Information: Reload was aborted.

(01/12/2023 13:05:47) Information: Closing the document.

(01/12/2023 13:05:47) Information: Closing the document.

(01/12/2023 13:05:47) Warning: Document was forcibly closed. Clean close was not possible. Exception: System.NullReferenceException: Object reference not set to an instance of an object. || at QVBWrapper.Document.NiceCloseThread(ILogBucket i_LogBucket)

(01/12/2023 13:05:47) Information: Closed the QlikView Engine successfully. ProcessID=3608484

(01/12/2023 13:05:47) Error: The task "ETL02_TransactionAnalysis" failed. Exception: || QDSMain.Exceptions.TaskFailedException: Task execution failed with errors to follow. ---> QDSMain.Exceptions.ReloadFailedException: Reload failed ---> QDSMain.Exceptions.ThreadPoolJobStillRunningException: Aborting reload. Error: QDSMain.TaskResult || at QDSMain.AbstractReloadTask.Reload(String fileName, IExecutingTaskResult executingTaskResult, String sectionAccessUserName, String sectionAccessPassword, eReloadOptions reloadOption, String variableName, String variableValue, Boolean moniterCpuUsage) || --- End of inner exception stack trace --- || at QDSMain.AbstractReloadTask.Reload(String fileName, IExecutingTaskResult executingTaskResult, String sectionAccessUserName, String sectionAccessPassword, eReloadOptions reloadOption, String variableName, String variableValue, Boolean moniterCpuUsage) || at QDSMain.DistributeTask.PerformExecute(IExecutingTaskResult executingTaskResult) || --- End of inner exception stack trace --- || at QDSMain.DistributeTask.PerformExecute(IExecutingTaskResult executingTaskResult) || at QDSMain.Task.AbstractTask.TaskExecution(CurrentExecutionArgs args)

(01/12/2023 13:05:47) Information: Task Execute Duration=00:15:31.2586208

(01/12/2023 13:05:47) Information: Sending Alert mail

(01/12/2023 13:05:48) Information: Closed the QlikView Engine successfully. ProcessID=3608484

(01/12/2023 13:07:53) Warning: Failed to send mail to analytics@jato.com

(01/12/2023 13:07:53) Information: TaskResult.status=Finished

(01/12/2023 13:07:53) Information: Notifying all triggers of new state: "FinishedWithErrors"...

(01/12/2023 13:07:53) Information: Notifying all triggers of new state: "FinishedWithErrors" - Completed

[Chip_Matejowsky]

Hello @KishoreSuriF,

Whenever you see  Error: The Source Document was NOT reloaded successfully in the task log, you'll want to check the document log of the QVW file, in your case ETL02_0_TransactionAnalysis.qvw. If document logging is enabled, it will be stored in the same directory in which the QVW file is housed. If document logging is not enabled, you will need to open the QVW file in QlikView Developer, click Settings > Document Properties > General tab and ensure the Generate Logfile checkbox is ticked. Then run the reload task so that the document log is generated.

You can refer to Qlik Support article The Source Document was NOT reloaded successfully for more details. Once you have the document log, provide it here if you need further assistance.

Best Regards

[KishoreSuriF]

Thanks for your quick response. We will check 

[KishoreSuriF]

We can see the error - 129- for the same task failure. Please help us to fix 

[KishoreSuriF]

@Chip_Matejowsky

[vincent_ardiet_]

Check the memory usage on your server when your reload this task, this could be due to a lack of ressources.
You may have to modify your code to make it lighter.

[Chip_Matejowsky]

Hi @KishoreSuriF,

Can you attach the full document log?

Can you successfully reload this QVW in QV Desktop?

Best Regards

[KishoreSuriF]

20231201T125018.615+0000 0175 TRACE **** Loading ST_BASE_VS_PURCHASED ****
  20231201T125018.616+0000 0175 **** Loading ST_BASE_VS_PURCHASED ****
  20231201T125018.616+0000 0176 
  20231201T125018.616+0000 0179 INCLUDED_SCHEMAS:
  20231201T125018.616+0000 0180   LOAD 
  20231201T125018.616+0000 0181      COD_SCHEMA_ID
  20231201T125018.616+0000 0182   FROM
  20231201T125018.616+0000 0183   [..\..\..\..\..\..\..\\QvSourceDocs\ROOT\Data\SupportFiles\SchemaManager.xlsx]
  20231201T125018.616+0000 0184   (ooxml, embedded labels, table is Schemas)
  20231201T125018.622+0000        1 fields found:  
  20231201T125018.630+0000      310 lines fetched
  20231201T125018.631+0000 0185 Concatenate
  20231201T125018.631+0000 0186   LOAD * INLINE [
  20231201T125018.631+0000 0187       COD_SCHEMA_ID
  20231201T125018.631+0000 0188       33902
  20231201T125018.631+0000 0189       31102
  20231201T125018.631+0000 0190       15202
  20231201T125018.631+0000 0191       17402
  20231201T125018.631+0000 0192   ]
  20231201T125018.631+0000        1 fields found: 
  20231201T125018.634+0000      314 lines fetched
  20231201T125018.635+0000 0194 left keep(INCLUDED_SCHEMAS)
  20231201T125018.635+0000 0195   LT_BASE_VS_PURCHASED:
  20231201T125018.635+0000 0196   LOAD *
  20231201T125018.635+0000 0197   FROM
  20231201T125018.635+0000 0198     [..\..\..\..\..\..\..\\QvSourceDocs\ROOT\Data\StagingArea\TransactionAnalysis\ST_BASE_VS_PURCHASED.qvd] (qvd)
  20231201T125018.638+0000        18 fields found:
  20231201T130417.467+0000      9,268,218,154 lines fetched
  20231201T130417.467+0000      Joining/Keeping
  20231201T130506.429+0000      -129 = 
  20231201T130546.762+0000      Execution Failed
  20231201T130546.768+0000      Execution finished.

[vincent_ardiet_ · Accepted solution]

Try to change the last load instructions with (and remove left keep(INCLUDED_SCHEMAS) )
LT_BASE_VS_PURCHASED:
LOAD * FROM [..\..\..\..\..\..\..\\QvSourceDocs\ROOT\Data\StagingArea\TransactionAnalysis\ST_BASE_VS_PURCHASED.qvd] (qvd)
WHERE EXISTS(COD_SCHEMA_ID)

[Chip_Matejowsky · Accepted solution]

Hi @KishoreSuriF,

Typically, -129 or -128 are most frequently caused by resource constraints; the system is out of memory. Have a look at Qlik Support article Error -129 or -128 when reloading an app.

I believe @vincent_ardiet_ is correct here in that the load script is causing QV to use excessive amounts of memory. Also have a look at this previous thread with a similar error:    https://community.qlik.com/t5/QlikView-App-Dev/Load-script-failed-due-to-joining-keeping/td-p/117677....

The QlikView Help entry on Join/Keep may be useful as well.

Best Regards