Application Development

[parvez933]

Hi!

How to build a dashboard, that shows only "Error Messages" from the task log of QMC.

Not sure, but the expectation is there is a place/Dump where the log files of both Success/Failure will be placed on the server ( if possible, please help where is that location from where the log files will be located).

Dashboard Requirements: 

A table which should be able to show only the "Failure Message" as below. 

Example:

Date	Task Name	App Name	Error Message
1/11/2021	ABC Task	ABC Data Model	Hive Reload is in progress
1/11/2021	ABC Task	ABC Data Model	IO Exception
1/11/2021	ABC Task	ABC Data Model	DSN Error
1/11/2021	ABC Task	ABC Data Model	SSL Error

Regards,

M. Parvez

[parvez933]

Hi All,

Please help!

QMC> Task> list of task> By clicking i option gives you Task Log file for both Failure and Success.

If we download the task log file for a failure task, it will show you the error message or the failure reason.

We have to created a dashboard, which should connect to the folder/location where all the log files will be stored both success and failure.

{ We should be able to read each task log message (both error /success). We are interested in Error/failure messages. }

In the front end, we have to create a table with Task Name and Error/Failure Message.

When we make a selection on date, we should get all the Tasks which are failed on the same date and the reason of failure.

Example Reason of Failure:

Error: Cannot open file: 'LIB://EA Sales Ops QVD/R3.3_AAR1184_1191_chamnlptnr_doal_dmnsn.qvd' (Native Path: \\qlik\Sales\QVD\QlikSense\EAA_Mount\R3.3_EAR1184_1291_chamnlptnr_doal_dmnsn.qvd

Please help!

Regards,

M. Parvez

[parvez933]

Hi All,

Please help!

QMC> Task> list of task> By clicking i option gives you Task Log file for both Failure and Success.

If we download the task log file for a failure task, it will show you the error message or the failure reason.

We have to created a dashboard, which should connect to the folder/location where all the log files will be stored both success and failure.

{ We should be able to read each task log message (both error /success). We are interested in Error/failure messages. }

In the front end, we have to create a table with Task Name and Error/Failure Message.

When we make a selection on date, we should get all the Tasks which are failed on the same date and the reason of failure.

Example Reason of Failure:

Error: Cannot open file: 'LIB://EA Sales Ops QVD/R3.3_AAR1184_1191_chamnlptnr_doal_dmnsn.qvd' (Native Path: \\qlik\Sales\QVD\QlikSense\EAA_Mount\R3.3_EAR1184_1291_chamnlptnr_doal_dmnsn.qvd

Please help!

Regards,

M. Parvez

[Ksrinivasan]

hi,

1. you have to file the log Path where it was stored in your server and directory or repository:

file path: QlikShare\ArchivedLogs\yourdomainname\Script

here all log are stored as .txt format.

2. you have to find and Match which log for which task.

Note: in log folder log file name like as below

fdd2ae7e-915f-40fc-9e4c-863b0332fe6b.20210118T221738.035+0530.8B27DD3BE74FE3A7BC9C

fdd2ae7e-915f-40fc-9e4c-863b0332fe6b = TASK Name it never change,

so you can match the task name and log file name.

.20210118 followed that date of execution date.

now task name and log file name and date of execution done.

3. if, you open every log in last three line are important that only having our required data, like as below:

if task failed,

20210118T221740.725+0530 Error: I/O error governanceLogContent_7.16.0_file.qvd
20210118T221740.731+0530 Execution Failed
20210118T221740.737+0530 Execution finished.

if task passed:

20210117T070111.217+0530 Indexing field: Posting_Date
20210117T070111.226+0530 Search index creation completed successfully
20210117T070111.226+0530 Execution finished.

4. Now we have to create load script:

for each task we have to capture below details by applying some logic

ERROR MESSAGE                                                                                                                                          | TASK No | Date

20210118T221740.725+0530 Error: I/O error governanceLogContent_7.16.0_file.qvd | TASK-1    |  18-01-2021

5. you can create visualization like  

Example:

Date	Task Name	App Name	Error Message
1/11/2021	ABC Task	ABC Data Model	Hive Reload is in progress
1/11/2021	ABC Task	ABC Data Model	IO Exception
1/11/2021	ABC Task	ABC Data Model	DSN Error
1/11/2021	ABC Task	ABC Data Model	SSL Error

try and best of luck,

ksrinivasan.

[parvez933]

Hi @Ksrinivasan ,

Thank You, for the steps. Will try to implement the same and share an update here for any concerns.

Regards,

M. Parvez