topic Re: Operations monitor reload task failed due to Connection error in Management & Governance

Operations monitor reload task failed due to Connection error

amithmurali — Sat, 16 Nov 2024 21:26:29 GMT

Dear Team,

One of our clients operations monitor failed to reload from the task scheduler. We had recently upgraded the server to November 2018 patch 1. Everything was working fine and this issue came up from past few days.

Thanks in Advance.

Please find the script log below.

2019-02-10 08:22:59 Execution started.
2019-02-10 08:22:59 Qlik Sense Server Version 12.244.6
2019-02-10 08:22:59 CPU Target x64
2019-02-10 08:22:59 Operating System Windows Server 2012 R2 Standard (64 bit edition)
2019-02-10 08:22:59 Wow64 mode Not using Wow64
2019-02-10 08:22:59 Language 0409 English English
2019-02-10 08:22:59 Country USA United States United States
2019-02-10 08:22:59 MDAC Version xxxxxxxxxxxxxxxx
2019-02-10 08:22:59 MDAC Full Install Version xxxxxxxxxxxxxxxx
2019-02-10 08:22:59 PreferredCompression 2
2019-02-10 08:22:59 EnableParallelReload 1
2019-02-10 08:22:59 ParallelizeQvdLoads 1
2019-02-10 08:22:59 EnableFlushLog 0
2019-02-10 08:22:59 UserLogfileCharset 65001
2019-02-10 08:22:59 OdbcLoginTimeout -1
2019-02-10 08:22:59 OdbcConnectionTimeout -1
2019-02-10 08:22:59 LongestPossibleLine 1048576
2019-02-10 08:22:59 WebFileTimeout 0
2019-02-10 08:22:59 WebFileUserAgent Mozilla/5.0
2019-02-10 08:22:59 DontUseInternetCache 1
2019-02-10 08:22:59 ScriptWantsDbWrite false
2019-02-10 08:22:59 ScriptWantsExe false
2019-02-10 08:22:59 ICU_FOR_CHARACTER_CLASSIFICATION true
2019-02-10 08:22:59 ICU_FOR_CODE_PAGES true
2019-02-10 08:22:59 ICU_FOR_COLLATION true
2019-02-10 08:22:59 ICU_FOR_LOCALE_INFO true
2019-02-10 08:22:59 ICU_FOR_SUPPORT_INFO true
2019-02-10 08:22:59 ICU_FOR_TIME_ZONE_INFO true
2019-02-10 08:22:59 LogFile CodePage Used: 65001
2019-02-10 08:22:59 UseMemoryFillPattern 1
2019-02-10 08:22:59 ScriptMode Standard (limits system access)
2019-02-10 08:22:59 SequentialThreadCount 8
2019-02-10 08:22:59 NumberOfCores (effective) 2
2019-02-10 08:22:59 ReloadCodebase Bnf
2019-02-10 08:22:59 Reload Executed By UserDirectory=INTERNAL; UserId=sa_scheduler
2019-02-10 08:22:59 Process Executing Qlik Sense Server
2019-02-10 08:22:59 Process ID 11144
2019-02-10 08:22:59 Grpc version 5.0.0
2019-02-10 08:22:59 Protobuf version 3.4.0
2019-02-10 08:22:59 0003 LET yr = year(ReloadTime())
2019-02-10 08:22:59 0004 SET copyright = 'Copyright 1993-2019 Qliktech International AB'
2019-02-10 08:22:59 0006 REM *** *** *** *** *** *** *** *** ****** *** *** *** *** *** *** ******
2019-02-10 08:22:59 0007 *** *** *** *** *** *** *** *** *** *** *** *** ***
2019-02-10 08:22:59 0008 *** *** *** *** *** ****** *** *** ******
2019-02-10 08:22:59 0009 *** *** *** *** *** ****** *** *** *** *** *** *** *** *** *** *** *** *** ***
2019-02-10 08:22:59 0011 SET db_v_file_override = 0
2019-02-10 08:22:59 0013 REM *** *** *** *** *** *** *** *** ****** *** *** *** *** *** *** *** *** *********
2019-02-10 08:22:59 0015 Let ReloadStartTime = now(1)
2019-02-10 08:22:59 0016 Set ahora =
2019-02-10 08:22:59 0016 SET msg =
2019-02-10 08:22:59 0016 SET skipped=0
2019-02-10 08:22:59 0016 SET loaded =0
2019-02-10 08:22:59 0016 SET textFile =
2019-02-10 08:22:59 0017 SET app_name = 'Operations Monitor'
2019-02-10 08:22:59 0018 SET app_version = '7.8.0'
2019-02-10 08:22:59 0019 Let comp = ComputerName()
2019-02-10 08:22:59 0020 LET EngineVer = PurgeChar(EngineVersion(),chr(39))
2019-02-10 08:22:59 0021 LET startMsg_1 = 'Reloading Operations Monitor 7.8.0 from AHQQLIK01 running QIX Engine version 12.244.6'
2019-02-10 08:22:59 0022 LET startMsg = 'Reloading Operations Monitor 7.8.0 from AHQQLIK01 running QIX Engine version 12.244.6. ' & If(db_v_file_override=2,'Database logs chosen',if(db_v_file_override=1,'File logs chosen','Default log source selected (will check database first, then files)'))
2019-02-10 08:22:59 0023 TRACE Reloading Operations Monitor 7.8.0 from AHQQLIK01 running QIX Engine version 12.244.6. Default log source selected (will check database first, then files)
2019-02-10 08:22:59 0023 Reloading Operations Monitor 7.8.0 from AHQQLIK01 running QIX Engine version 12.244.6. Default log source selected (will check database first, then files)
2019-02-10 08:22:59 0024
2019-02-10 08:22:59 0025 SET monthsOfHistory = 3
2019-02-10 08:22:59 0026 LET cutoffDate = AddMonths(today(1),-3,1)
2019-02-10 08:22:59 0027 Let LastReloadTime = timestamp(alt(LastSuccessfulReloadStartTime,cutoffDate))
2019-02-10 08:22:59 0028 Let lastReloadCompare = num(LastReloadTime)-1
2019-02-10 08:22:59 0030 LET serverLogFolder = 'lib://ServerLogFolder/'
2019-02-10 08:22:59 0031 LET archivedLogsFolder = 'lib://ArchivedLogsFolder/'
2019-02-10 08:22:59 0033 LET baseFileName = 'governanceLogContent_7.8.0'
2019-02-10 08:22:59 0034 LET baseTableName = 'lib://ServerLogFolder/governanceLogContent_7.8.0'
2019-02-10 08:22:59 0035 LET serviceFileName = 'governanceServiceLog_7.8.0'
2019-02-10 08:22:59 0036 LET serviceTableName = 'lib://ServerLogFolder/governanceServiceLog_7.8.0'
2019-02-10 08:22:59 0037 LET time_range_FileName = 'governance_time_range_ops_7.8.0'
2019-02-10 08:22:59 0038 LET time_range_TableName = 'lib://ServerLogFolder/governance_time_range_ops_7.8.0'
2019-02-10 08:22:59 0039 LET date_time_FileName = 'governance_date_time_ops_7.8.0'
2019-02-10 08:22:59 0040 LET date_time_TableName = 'lib://ServerLogFolder/governance_date_time_ops_7.8.0'
2019-02-10 08:22:59 0041 LET monitorAppStatsFile = 'lib://ServerLogFolder/Operations_Monitor_Reload_Stats_7.8.0.txt'
2019-02-10 08:22:59 0043 SET hideprefix = 'log'
2019-02-10 08:22:59 0044 SET firstReload = 0
2019-02-10 08:22:59 0047 SET TimeFormat = 'hh:mm:ss'
2019-02-10 08:22:59 0048 SET DateFormat = 'YYYY-MM-DD'
2019-02-10 08:22:59 0049 SET TimestampFormat = 'YYYY-MM-DD hh:mm:ss'
2019-02-10 08:22:59 0051 Let vLast4Hours = Num(timestamp(Now(1)-1/6))
2019-02-10 08:22:59 0052 Let vLast24Hours = Num(timestamp(Now(1)-1))
2019-02-10 08:22:59 0053 Let vLast72Hours = Num(timestamp(Now(1)-3))
2019-02-10 08:22:59 0055 SUB verify_database
2019-02-10 08:22:59 0140 SUB logList
2019-02-10 08:22:59 0169 SUB defineFields
2019-02-10 08:22:59 0278 SUB mappingLoads
2019-02-10 08:22:59 0303 SUB load_base_table (nombre, archivo, timestamp_field)
2019-02-10 08:22:59 0355 SUB multiNodeConfig
2019-02-10 08:22:59 0386 SUB logFolderList
2019-02-10 08:22:59 0429 SUB loadFiles (fdr,iter)
2019-02-10 08:22:59 0481 SUB load_database_logs
2019-02-10 08:22:59 0646 SUB calendarization
2019-02-10 08:22:59 0731 SUB calendarization_add
2019-02-10 08:22:59 0814 SUB concat_tables (concatToTable, incrementalTable, concatField)
2019-02-10 08:22:59 0841 SUB store_files (nombre, archivo)
2019-02-10 08:22:59 0864 SUB serviceLog
2019-02-10 08:22:59 0909 SUB reloadSummary
2019-02-10 08:22:59 0995 SUB sessionSummary
2019-02-10 08:22:59 1073 SUB exportingSummary
2019-02-10 08:22:59 1162 SUB monitor_app_stats_incremental // Use this to append new 'status' entry to table
2019-02-10 08:22:59 1176 SUB monitor_app_reload_stats (sev, obj, message, description)
2019-02-10 08:22:59 1211 SUB QRS
2019-02-10 08:22:59 1238 SUB monitor_apps_REST_user
2019-02-10 08:22:59 1320 SUB monitor_apps_REST_app
2019-02-10 08:22:59 1449 SUB monitor_apps_REST_appobject
2019-02-10 08:22:59 1543 SUB monitor_apps_REST_task
2019-02-10 08:22:59 1925 SUB supportingLogic
2019-02-10 08:22:59 1983 SUB finalize
2019-02-10 08:22:59 2022 CALL monitor_app_reload_stats('INFO','Operations Monitor', startMsg,'Reload Start')
2019-02-10 08:22:59 1178 TRACE Working on Monitor App Reload Stats
2019-02-10 08:22:59 1178 Working on Monitor App Reload Stats
2019-02-10 08:22:59 1179
2019-02-10 08:22:59 1180 IF description = 'Reload Start' THEN
2019-02-10 08:22:59 1182 IF FileSize('lib://ServerLogFolder/Operations_Monitor_Reload_Stats_7.8.0.txt') > 0 THEN
2019-02-10 08:22:59 1183 monitor_app_reload_stats:
2019-02-10 08:22:59 1184 Load * From 'lib://ServerLogFolder/Operations_Monitor_Reload_Stats_7.8.0.txt' (txt, utf8, embedded labels, delimiter is '\t', msq)
2019-02-10 08:22:59 7 fields found: Log Entry, Log Timestamp, Log Severity, Host, Description, Log Message, Object,
2019-02-10 08:22:59 20,600 lines fetched
2019-02-10 08:22:59 1185 ELSE
2019-02-10 08:22:59 1191 Let appMonitorStatsRowsInit = NoOfRows('monitor_app_reload_stats')
2019-02-10 08:22:59 1192 CALL monitor_app_stats_incremental // Add start message
2019-02-10 08:22:59 1163 Concatenate (monitor_app_reload_stats)
2019-02-10 08:22:59 1164 Load
2019-02-10 08:22:59 1165 RowNo() as [Log Entry],
2019-02-10 08:22:59 1166 timestamp(now(1)) as [Log Timestamp],
2019-02-10 08:22:59 1167 'INFO' as [Log Severity],
2019-02-10 08:22:59 1168 'AHQQLIK01' as Host,
2019-02-10 08:22:59 1169 'Reload Start' as Description,
2019-02-10 08:22:59 1170 'Reloading Operations Monitor 7.8.0 from AHQQLIK01 running QIX Engine version 12.244.6. Default log source selected (will check database first, then files)' as [Log Message],
2019-02-10 08:22:59 1171 'Operations Monitor' as Object
2019-02-10 08:22:59 1172 AutoGenerate (1)
2019-02-10 08:22:59 7 fields found: Log Entry, Log Timestamp, Log Severity, Host, Description, Log Message, Object,
2019-02-10 08:22:59 20,601 lines fetched
2019-02-10 08:22:59 1174 ENDSUB
2019-02-10 08:22:59 1194 ELSEIF description = 'Status Message' THEN
2019-02-10 08:22:59 1208 ENDSUB
2019-02-10 08:22:59 2024 CALL verify_database
2019-02-10 08:22:59 0057 TRACE Verifying logging database.
2019-02-10 08:22:59 0057 Verifying logging database.
2019-02-10 08:22:59 0058
2019-02-10 08:22:59 0059 REM *** *** *** *** *** *** *** *** *** *** *** ***
2019-02-10 08:22:59 0061 IF db_v_file_override = 1 THEN
2019-02-10 08:22:59 0072 LET db_check_time = timestamp(now(1)-0.01)
2019-02-10 08:22:59 0073 Set errormode = 0
2019-02-10 08:22:59 0075 LIB CONNECT TO 'QLogs'
2019-02-10 08:23:00 Connected.
2019-02-10 08:23:00 0078 LET tempErrorDetails = ScriptErrorDetails
2019-02-10 08:23:00 0079 IF Len(tempErrorDetails) > 0 THEN
2019-02-10 08:23:00 0093 db_check:
2019-02-10 08:23:00 0094 SELECT "id"
2019-02-10 08:23:00 0095 FROM "public"."log_entries"
2019-02-10 08:23:00 0096 WHERE "entry_timestamp" >= '2019-02-10 12:08:35'
2019-02-10 08:23:00 Error: Connector reply error: Unable to connect to database:
2019-02-10 08:23:00 Connection failed:
2019-02-10 08:23:00 Please check the values for Username‚ Password‚ Host‚ and other properties.
2019-02-10 08:23:00 0100 LET tempErrorDetails = ScriptErrorDetails
2019-02-10 08:23:00 0101 IF Len(tempErrorDetails) > 0 THEN
2019-02-10 08:23:00 0102 trace ERROR: Connector reply error: ***
2019-02-10 08:23:00 0102 ERROR: Connector reply error: ***
2019-02-10 08:23:00 0103
2019-02-10 08:23:00 0103 CALL monitor_app_reload_stats('WARN','', tempErrorDetails, 'Status Message')
2019-02-10 08:23:00 1178 TRACE Working on Monitor App Reload Stats
2019-02-10 08:23:00 1178 Working on Monitor App Reload Stats
2019-02-10 08:23:00 1179
2019-02-10 08:23:00 1180 IF description = 'Reload Start' THEN
2019-02-10 08:23:00 1195 CALL monitor_app_stats_incremental // Add status message
2019-02-10 08:23:00 1163 Concatenate (monitor_app_reload_stats)
2019-02-10 08:23:00 1164 Load
2019-02-10 08:23:00 1165 RowNo() as [Log Entry],
2019-02-10 08:23:00 1166 timestamp(now(1)) as [Log Timestamp],
2019-02-10 08:23:00 1167 'WARN' as [Log Severity],
2019-02-10 08:23:00 1168 'AHQQLIK01' as Host,
2019-02-10 08:23:00 1169 'Status Message' as Description,
2019-02-10 08:23:00 1170 'Connector reply error: ***' as [Log Message],
2019-02-10 08:23:00 1171 '' as Object
2019-02-10 08:23:00 1172 AutoGenerate (1)
2019-02-10 08:23:00 7 fields found: Log Entry, Log Timestamp, Log Severity, Host, Description, Log Message, Object,
2019-02-10 08:23:00 20,602 lines fetched
2019-02-10 08:23:00 1174 ENDSUB
2019-02-10 08:23:00 1197 ELSEIF description = 'Reload Finish' THEN
2019-02-10 08:23:00 1208 ENDSUB
2019-02-10 08:23:00 0104 tempErrorDetails =
2019-02-10 08:23:00 0105 TRACE Could not validate active database logging. Sourcing from file logs instead.
2019-02-10 08:23:00 0105 Could not validate active database logging. Sourcing from file logs instead.
2019-02-10 08:23:00 0106
2019-02-10 08:23:00 0106 SET db_v_file = 1
2019-02-10 08:23:00 0107 LET baseTableName = 'lib://ServerLogFolder/governanceLogContent_7.8.0_file'
2019-02-10 08:23:00 0108 LET lastReloadCompare = If(LastReloadSource=1,lastReloadCompare,cutoffDate)
2019-02-10 08:23:00 0110 TRACE Last Reload Compare time = 43505.467997685. CutoffDate = 2018-11-10.
2019-02-10 08:23:00 0110 Last Reload Compare time = 43505.467997685. CutoffDate = 2018-11-10.
2019-02-10 08:23:00 0111
2019-02-10 08:23:00 0111 DisConnect
2019-02-10 08:23:00 0112 SET errormode=1
2019-02-10 08:23:00 0113 EXIT SUB
2019-02-10 08:23:00 2026 REM *** *** *** ********* *** *** *** ***
2019-02-10 08:23:00 2027 CALL load_base_table ('LogContent', 'lib://ServerLogFolder/governanceLogContent_7.8.0_file','LogTimeStamp')
2019-02-10 08:23:00 0305 TRACE Checking for base qvd
2019-02-10 08:23:00 0305 Checking for base qvd
2019-02-10 08:23:00 0306
2019-02-10 08:23:00 0306 Let ts_field = '"LogTimeStamp"'
2019-02-10 08:23:00 0309 Let baseFileSize = FileSize('lib://ServerLogFolder/governanceLogContent_7.8.0_file.qvd')
2019-02-10 08:23:00 0311 IF baseFileSize > 0 THEN // Yes - QVD exists = not first load
2019-02-10 08:23:00 0313 trace Incremental reload of LogContent table (i.e. not first reload)
2019-02-10 08:23:00 0313 Incremental reload of LogContent table (i.e. not first reload)
2019-02-10 08:23:00 0314
2019-02-10 08:23:00 0314 Let firstReload = 0
2019-02-10 08:23:00 0316 LogContent:
2019-02-10 08:23:00 0317 NoConcatenate
2019-02-10 08:23:00 0318 Load * FROM [lib://ServerLogFolder/governanceLogContent_7.8.0_file.qvd] (qvd)
2019-02-10 08:23:00 0319 WHERE LogTimeStamp >= '2018-11-10'
2019-02-10 08:23:00 51 fields found: Id, LogEntryPeriodStart, LogTimeStamp, Service, Hostname, Message, Export Count, Export Store Count, Description, ProxyPackageId, RequestSequenceId, _date_time_link, _proxySessionPackage, Reload from Hub, TaskExecution, TaskId, UserId, ObjectId, ObjectName, ProxySessionId, Context, Command, Result, App Name, ProductVersion, Sequence#, qmc_change, QMC Resource Type, SecurityClass, ClientHostAddress, Severity, ActiveDocSessions, ActiveDocs, ActiveUsers, CPULoad, LoadedDocs, Selections, VMCommitted, VMAllocated, VMFree, VMPctCommitted, Cache Hits, Cache Lookups, Cache Bytes Added, Session Duration, Session Selections, Session Count, Session CPU Spent (ms), Reload CPU Spent (ms), Session KBytes Sent+Received, Reload KBytes Sent+Received,
2019-02-10 08:23:00 Error: I/O error governanceLogContent_7.8.0_file.qvd
2019-02-10 08:23:00 Execution Failed
2019-02-10 08:23:00 Execution finished.

Re: Operations monitor reload task failed due to Connection error

MynhardtBurger — Tue, 19 Feb 2019 13:35:52 GMT

I am having the same error. When I duplicated the License Monitor app and ran it myself I got the following additional information:

I/O error governanceLicenseLog_7.10.0_file.qvd:
 
LogContent: 
NoConcatenate 
Load * FROM lib://ServerLogFolder/governanceLicenseLog_7.10.0_file.qvd (qvd) 
WHERE LogTimeStamp >= '2018-02-19'

ScriptErrorList: Database Not Found File Has Wrong Format

When I try to open the underlying governanceLicenseLog_7.10.0_file.qvd file using QViewer I get an "Index was outside the bounds of the array" error. I suspect the file somehow got corrupt.

I ended up deleting the corrupt qvd and rerunning the task. I am not sure if I lost some log history in the process, but at least the task is running again.

Re: Operations monitor reload task failed due to Connection error

Brett_Bleess — Thu, 14 Mar 2019 13:23:26 GMT

Hey guys, I believe the correct thing here is to let the QVD file recreate, I know the guys that do the Governance Dashboard have told us as much on it, so I am assuming same goes for the Sense monitoring apps as well. The next run should then recreate things from scratch, which may cause that load to run a little longer than normal, but once it is recreated, things should be quicker after that again. Hopefully this is what you needed to continue moving forward. I will be moving the post as well to the product forums, someone else may have something to add there.

Regards,
Brett

Re: Operations monitor reload task failed due to Connection error

KishoreSuri — Tue, 16 Apr 2019 10:23:19 GMT

2019-04-16 10:18:34 Execution started.
2019-04-16 10:18:34 Qlik Sense Server Version 12.287.2
2019-04-16 10:18:34 CPU Target x64
2019-04-16 10:18:34 Operating System Windows Server 2012 R2 Standard (64 bit edition)
2019-04-16 10:18:34 Wow64 mode Not using Wow64
2019-04-16 10:18:34 Language 0409 English English
2019-04-16 10:18:34 Country USA United States United States
2019-04-16 10:18:34 MDAC Version 6.3.9600.16384
2019-04-16 10:18:34 MDAC Full Install Version 6.3.9600.16384
2019-04-16 10:18:34 PreferredCompression 2
2019-04-16 10:18:34 EnableParallelReload 1
2019-04-16 10:18:34 ParallelizeQvdLoads 1
2019-04-16 10:18:34 AutoSaveAfterReload 0
2019-04-16 10:18:34 BackupBeforeReload 0
2019-04-16 10:18:34 EnableFlushLog 0
2019-04-16 10:18:34 UserLogfileCharset 65001
2019-04-16 10:18:34 OdbcLoginTimeout -1
2019-04-16 10:18:34 OdbcConnectionTimeout -1
2019-04-16 10:18:34 LongestPossibleLine 1048576
2019-04-16 10:18:34 MaxCoreMask -1
2019-04-16 10:18:34 WebFileTimeout 0
2019-04-16 10:18:34 WebFileUserAgent Mozilla/5.0
2019-04-16 10:18:34 DontUseInternetCache 1
2019-04-16 10:18:34 ScriptWantsDbWrite false
2019-04-16 10:18:34 ScriptWantsExe false
2019-04-16 10:18:34 ICU_FOR_CHARACTER_CLASSIFICATION true
2019-04-16 10:18:34 ICU_FOR_CODE_PAGES true
2019-04-16 10:18:34 ICU_FOR_COLLATION true
2019-04-16 10:18:34 ICU_FOR_LOCALE_INFO true
2019-04-16 10:18:34 ICU_FOR_SUPPORT_INFO true
2019-04-16 10:18:34 ICU_FOR_TIME_ZONE_INFO true
2019-04-16 10:18:34 LogFile CodePage Used: 65001
2019-04-16 10:18:34 UseMemoryFillPattern 1
2019-04-16 10:18:34 ScriptMode Standard (limits system access)
2019-04-16 10:18:34 SequentialThreadCount 26
2019-04-16 10:18:34 NumberOfCores (effective) 8
2019-04-16 10:18:34 ReloadCodebase Bnf
2019-04-16 10:18:34 Reload Executed By UserDirectory=INTERNAL; UserId=sa_scheduler
2019-04-16 10:18:34 Process Executing Qlik Sense Server
2019-04-16 10:18:34 Process ID 4184
2019-04-16 10:18:34 Grpc version 5.0.0
2019-04-16 10:18:34 Protobuf version 3.4.0
2019-04-16 10:18:34 0003 LET yr = year(ReloadTime())
2019-04-16 10:18:34 0004 SET copyright = 'Copyright 1993-2019 Qliktech International AB'
2019-04-16 10:18:34 0006 REM *** *** *** *** *** *** *** *** ****** *** *** *** *** *** *** ******
2019-04-16 10:18:34 0007 *** *** *** *** *** *** *** *** *** *** *** *** ***
2019-04-16 10:18:34 0008 *** *** *** *** *** ****** *** *** ******
2019-04-16 10:18:34 0009 *** *** *** *** *** ****** *** *** *** *** *** *** *** *** *** *** *** *** ***
2019-04-16 10:18:34 0011 SET db_v_file_override = 0
2019-04-16 10:18:34 0013 REM *** *** *** *** *** *** *** *** ****** *** *** *** *** *** *** *** *** *********
2019-04-16 10:18:34 0015 Let ReloadStartTime = now(1)
2019-04-16 10:18:34 0016 Set ahora =
2019-04-16 10:18:34 0016 SET msg =
2019-04-16 10:18:34 0016 SET skipped=0
2019-04-16 10:18:34 0016 SET loaded =0
2019-04-16 10:18:34 0016 SET textFile =
2019-04-16 10:18:34 0017 SET app_name = 'License Monitor'
2019-04-16 10:18:34 0018 SET app_version = '7.10.0'
2019-04-16 10:18:34 0019 Let comp = ComputerName()
2019-04-16 10:18:34 0020 LET EngineVer = PurgeChar(EngineVersion(),chr(39))
2019-04-16 10:18:34 0021 LET startMsg_1 = 'Reloading License Monitor 7.10.0 from APPS-VM running QIX Engine version 12.287.2'
2019-04-16 10:18:34 0022 LET startMsg = 'Reloading License Monitor 7.10.0 from APPS-VM running QIX Engine version 12.287.2. ' & If(db_v_file_override=2,'Database logs chosen',if(db_v_file_override=1,'File logs chosen','Default log source selected (will check database first, then files)'))
2019-04-16 10:18:34 0023 TRACE Reloading License Monitor 7.10.0 from APPS-VM running QIX Engine version 12.287.2. Default log source selected (will check database first, then files)
2019-04-16 10:18:34 0023 Reloading License Monitor 7.10.0 from APPS-VM running QIX Engine version 12.287.2. Default log source selected (will check database first, then files)
2019-04-16 10:18:34 0024
2019-04-16 10:18:34 0025 SET monthsOfHistory = 12
2019-04-16 10:18:34 0026 LET cutoffDate = AddMonths(today(),-12,1)
2019-04-16 10:18:34 0027 Let LastReloadTime = timestamp(if(isnull(LastSuccessfulReloadStartTime),cutoffDate,LastSuccessfulReloadStartTime))
2019-04-16 10:18:34 0028 Let lastReloadCompare = num(LastReloadTime)-1
2019-04-16 10:18:34 0029 SET minSenseActivityDate = 42005
2019-04-16 10:18:34 0031 SET hideprefix = 'log'
2019-04-16 10:18:34 0032 SET firstReload = 0
2019-04-16 10:18:34 0033 SET va_LoginToUserPass = 10
2019-04-16 10:18:34 0035 LET serverLogFolder = 'lib://ServerLogFolder/'
2019-04-16 10:18:34 0036 LET archivedLogsFolder = 'lib://ArchivedLogsFolder/'
2019-04-16 10:18:34 0037 SET central_node_name =
2019-04-16 10:18:34 0039 LET baseFileName = 'governanceLicenseLog_7.10.0'
2019-04-16 10:18:34 0040 LET baseTableName = 'lib://ServerLogFolder/governanceLicenseLog_7.10.0'
2019-04-16 10:18:34 0042 LET SessionFileName = 'governanceSession_7.10.0'
2019-04-16 10:18:34 0043 LET sessionTableName = 'lib://ServerLogFolder/governanceSession_7.10.0'
2019-04-16 10:18:34 0044 LET monitorAppStatsFile = 'lib://ServerLogFolder/License_Monitor_Reload_Stats_7.10.0.txt'
2019-04-16 10:18:34 0046 SET storeBaseTableFail = 0
2019-04-16 10:18:34 0047 LET tempErrorDetails =
2019-04-16 10:18:34 0050 SET TimeFormat = 'hh:mm:ss'
2019-04-16 10:18:34 0051 SET DateFormat = 'YYYY-MM-DD'
2019-04-16 10:18:34 0052 SET TimestampFormat = 'YYYY-MM-DD hh:mm:ss'
2019-04-16 10:18:34 0054 Let vLast72Hours = Num(timestamp(Now(1)-3))
2019-04-16 10:18:34 0055 Let vLast7Days = Num(timestamp(Now(1)-7))
2019-04-16 10:18:34 0056 Let vLast14Days = Num(timestamp(Now(1)-14))
2019-04-16 10:18:34 0057 Let vLast28Days = Num(timestamp(Now(1)-28))
2019-04-16 10:18:34 0058 Let vLast90Days = Num(timestamp(Now(1)-90))
2019-04-16 10:18:34 0061 set c_red = 'RGB(204,102,119)'
2019-04-16 10:18:34 0062 set c_yellow = 'RGB(221,204,119)'
2019-04-16 10:18:34 0063 set c_blue = 'RGB(68,119,170)'
2019-04-16 10:18:34 0064 set c_green = 'RGB(17,119,51)'
2019-04-16 10:18:34 0065 set c_gray = 'RGB(150,150,150)'
2019-04-16 10:18:34 0066 set c_lightred = 'RGB(240,209,214)'
2019-04-16 10:18:34 0067 set c_lightblue = 'RGB(188,181,201)'
2019-04-16 10:18:34 0070 SUB verify_database
2019-04-16 10:18:34 0157 SUB logList
2019-04-16 10:18:34 0168 SUB defineFields
2019-04-16 10:18:34 0178 SUB CommandList
2019-04-16 10:18:34 0200 SUB loadBaseTable (nombre, archivo)
2019-04-16 10:18:34 0248 SUB multiNodeConfig
2019-04-16 10:18:34 0275 SUB logFolderList
2019-04-16 10:18:34 0318 SUB loadFiles (fdr,iter)
2019-04-16 10:18:34 0404 SUB load_database_logs
2019-04-16 10:18:34 0479 SUB concatTables (concatToTable, incrementalTable, concatField)
2019-04-16 10:18:34 0520 SUB sessionData (fdr)
2019-04-16 10:18:34 0562 SUB storeFiles (nombre, archivo)
2019-04-16 10:18:34 0583 SUB monitor_app_stats_incremental // Use this to append new 'status' entry to table
2019-04-16 10:18:34 0597 SUB monitor_app_reload_stats (sev, obj, message, description)
2019-04-16 10:18:34 0629 SUB QRS
2019-04-16 10:18:34 0656 SUB monitor_apps_REST_license_user
2019-04-16 10:18:34 0761 SUB monitor_apps_REST_license_login
2019-04-16 10:18:34 0792 SUB monitor_apps_REST_user
2019-04-16 10:18:34 0902 SUB monitor_apps_REST_license_access
2019-04-16 10:18:34 1011 SUB monitor_apps_REST_app
2019-04-16 10:18:34 1046 SUB calendarization
2019-04-16 10:18:34 1153 SUB supportingLogic
2019-04-16 10:18:34 1215 SUB finalize
2019-04-16 10:18:34 1252 CALL monitor_app_reload_stats('INFO','License Monitor', startMsg,'Reload Start')
2019-04-16 10:18:34 0599 IF description = 'Reload Start' THEN
2019-04-16 10:18:34 0601 IF FileSize('lib://ServerLogFolder/License_Monitor_Reload_Stats_7.10.0.txt') > 0 THEN
2019-04-16 10:18:34 0605 Trace Did not find lib://ServerLogFolder/License_Monitor_Reload_Stats_7.10.0.txt - will create a new file.
2019-04-16 10:18:34 0605 Did not find lib://ServerLogFolder/License_Monitor_Reload_Stats_7.10.0.txt - will create a new file.
2019-04-16 10:18:34 0606
2019-04-16 10:18:34 0606 monitor_app_reload_stats:
2019-04-16 10:18:34 0607 Load * Inline [Log Entry, Log Timestamp, Log Severity,Host,Description,Log Message,Object]
2019-04-16 10:18:34 7 fields found: Log Entry, Log Timestamp, Log Severity, Host, Description, Log Message, Object,
2019-04-16 10:18:34 0 lines fetched
2019-04-16 10:18:34 0608 ENDIF
2019-04-16 10:18:34 0610 Let appMonitorStatsRowsInit = NoOfRows('monitor_app_reload_stats')
2019-04-16 10:18:34 0611 CALL monitor_app_stats_incremental // Add start message
2019-04-16 10:18:34 0584 Concatenate (monitor_app_reload_stats)
2019-04-16 10:18:34 0585 Load
2019-04-16 10:18:34 0586 RowNo() as [Log Entry],
2019-04-16 10:18:34 0587 timestamp(now(1)) as [Log Timestamp],
2019-04-16 10:18:34 0588 'INFO' as [Log Severity],
2019-04-16 10:18:34 0589 'APPS-VM' as Host,
2019-04-16 10:18:34 0590 'Reload Start' as Description,
2019-04-16 10:18:34 0591 'Reloading License Monitor 7.10.0 from APPS-VM running QIX Engine version 12.287.2. Default log source selected (will check database first, then files)' as [Log Message],
2019-04-16 10:18:34 0592 'License Monitor' as Object
2019-04-16 10:18:34 0593 AutoGenerate (1)
2019-04-16 10:18:34 7 fields found: Log Entry, Log Timestamp, Log Severity, Host, Description, Log Message, Object,
2019-04-16 10:18:34 1 lines fetched
2019-04-16 10:18:34 0595 ENDSUB
2019-04-16 10:18:34 0613 ELSEIF description = 'Status Message' THEN
2019-04-16 10:18:34 0626 ENDSUB
2019-04-16 10:18:34 1254 CALL verify_database
2019-04-16 10:18:34 0072 TRACE Verifying logging database.
2019-04-16 10:18:34 0072 Verifying logging database.
2019-04-16 10:18:34 0073
2019-04-16 10:18:34 0074 REM *** *** *** *** *** *** *** *** *** *** *** ***
2019-04-16 10:18:34 0076 IF db_v_file_override = 1 THEN
2019-04-16 10:18:34 0087 LET db_check_time = timestamp(now(1)-0.01)
2019-04-16 10:18:34 0088 Set errormode = 0
2019-04-16 10:18:34 0090 LIB CONNECT TO 'QLogs'
2019-04-16 10:18:35 Connected.
2019-04-16 10:18:35 0096 LET tempErrorDetails = ScriptErrorDetails
2019-04-16 10:18:35 0097 IF Len(tempErrorDetails) > 0 THEN
2019-04-16 10:18:35 0111 db_check:
2019-04-16 10:18:35 0112 SELECT "id"
2019-04-16 10:18:35 0113 FROM "public"."log_entries"
2019-04-16 10:18:35 0114 WHERE "entry_timestamp" >= '2019-04-16 03:04:10'
2019-04-16 10:18:35 1 fields found: id,
2019-04-16 10:18:35 0 lines fetched
2019-04-16 10:18:35 0118 LET tempErrorDetails = ScriptErrorDetails
2019-04-16 10:18:35 0119 IF Len(tempErrorDetails) > 0 THEN
2019-04-16 10:18:35 0133 Let NoOfRows_db_check = NoOfRows('db_check')
2019-04-16 10:18:35 0135 IF 0>1 THEN
2019-04-16 10:18:35 0143 TRACE Could not validate active database logging. Sourcing from file logs instead.
2019-04-16 10:18:35 0143 Could not validate active database logging. Sourcing from file logs instead.
2019-04-16 10:18:35 0144
2019-04-16 10:18:35 0144 SET db_v_file = 1
2019-04-16 10:18:35 0145 LET baseTableName = 'lib://ServerLogFolder/governanceLicenseLog_7.10.0_file'
2019-04-16 10:18:35 0146 LET lastReloadCompare = If(LastReloadSource=1,lastReloadCompare,cutoffDate)
2019-04-16 10:18:35 0148 TRACE Last Reload Compare time = 2018-04-16. CutoffDate = 2018-04-16.
2019-04-16 10:18:35 0148 Last Reload Compare time = 2018-04-16. CutoffDate = 2018-04-16.
2019-04-16 10:18:35 0149
2019-04-16 10:18:35 0149 DISCONNECT
2019-04-16 10:18:35 0150 ENDIF
2019-04-16 10:18:35 0152 SET errormode = 1
2019-04-16 10:18:35 0154 ENDIF // For db_v_file_override---> verifying existence of active logging database
2019-04-16 10:18:35 0155 ENDSUB
2019-04-16 10:18:35 1256 REM *** *** *** ********* *** *** *** ***
2019-04-16 10:18:35 1257 CALL loadBaseTable ('LogContent', 'lib://ServerLogFolder/governanceLicenseLog_7.10.0_file') // Main License_Repository logs
2019-04-16 10:18:35 0202 Let baseFileSize = FileSize('lib://ServerLogFolder/governanceLicenseLog_7.10.0_file.qvd')
2019-04-16 10:18:35 0204 IF baseFileSize > 0 THEN // Yes - QVD exists = not first load
2019-04-16 10:18:35 0223 trace Initial Load
2019-04-16 10:18:35 0223 Initial Load
2019-04-16 10:18:35 0224
2019-04-16 10:18:35 0224 Let firstReload = 1
2019-04-16 10:18:35 0225 LET lastReloadCompare = num(cutoffDate)
2019-04-16 10:18:35 0226 Let LastReloadTime = timestamp(cutoffDate)
2019-04-16 10:18:35 0228 IF nombre = 'LogContent' THEN // License Repository log data
2019-04-16 10:18:35 0229 LogContent:
2019-04-16 10:18:35 0230 NoConcatenate
2019-04-16 10:18:35 0231 Load * Inline [Id, LogEntryPeriodStart, LogTimeStamp,Hostname,Message
2019-04-16 10:18:35 0232 ]
2019-04-16 10:18:35 5 fields found: Id, LogEntryPeriodStart, LogTimeStamp, Hostname, Message,
2019-04-16 10:18:35 0 lines fetched
2019-04-16 10:18:35 0233 ELSEIF nombre = 'sessionData' THEN // nombre = 'sessionData' > Session_Engine log data
2019-04-16 10:18:35 0241 END IF
2019-04-16 10:18:35 0243 LET NoOfRowsLogContentBASE = NoOfRows('LogContent')
2019-04-16 10:18:35 0245 ENDSUB
2019-04-16 10:18:35 1258 CALL loadBaseTable ('sessionData','lib://ServerLogFolder/governanceSession_7.10.0') // Session_Engine log for App Name TODO App Name for License
2019-04-16 10:18:35 0202 Let baseFileSize = FileSize('lib://ServerLogFolder/governanceSession_7.10.0.qvd')
2019-04-16 10:18:35 0204 IF baseFileSize > 0 THEN // Yes - QVD exists = not first load
2019-04-16 10:18:35 0223 trace Initial Load
2019-04-16 10:18:35 0223 Initial Load
2019-04-16 10:18:35 0224
2019-04-16 10:18:35 0224 Let firstReload = 1
2019-04-16 10:18:35 0225 LET lastReloadCompare = num(cutoffDate)
2019-04-16 10:18:35 0226 Let LastReloadTime = timestamp(cutoffDate)
2019-04-16 10:18:35 0228 IF nombre = 'LogContent' THEN // License Repository log data
2019-04-16 10:18:35 0234 sessionData:
2019-04-16 10:18:35 0235 NoConcatenate
2019-04-16 10:18:35 0236 Load * Inline [ProxySessionId,LogTimeStamp]
2019-04-16 10:18:35 2 fields found: ProxySessionId, LogTimeStamp,
2019-04-16 10:18:35 0 lines fetched
2019-04-16 10:18:35 0237 ELSE
2019-04-16 10:18:35 0241 END IF
2019-04-16 10:18:35 0243 LET NoOfRowssessionDataBASE = NoOfRows('sessionData')
2019-04-16 10:18:35 0245 ENDSUB
2019-04-16 10:18:35 1260 REM *** *** ***
2019-04-16 10:18:35 1261 CALL CommandList
2019-04-16 10:18:35 0180 CommandList:
2019-04-16 10:18:35 0181 LOAD
2019-04-16 10:18:35 0182 Command,
2019-04-16 10:18:35 0183 CommandType
2019-04-16 10:18:35 0184 Inline [
2019-04-16 10:18:35 0185 Command, CommandType
2019-04-16 10:18:35 0186 Add license, Allocation
2019-04-16 10:18:35 0187 Add user access, Usage
2019-04-16 10:18:35 0188 Delete user access, Allocation
2019-04-16 10:18:35 0189 License maintenance, Usage
2019-04-16 10:18:35 0190 License user access, Usage
2019-04-16 10:18:35 0191 License user access request, Usage
2019-04-16 10:18:35 0192 Request access type, Usage
2019-04-16 10:18:35 0193 Update license, Allocation
2019-04-16 10:18:35 0194 Update user access, Allocation
2019-04-16 10:18:35 0195 ]
2019-04-16 10:18:35 2 fields found: Command, CommandType,
2019-04-16 10:18:35 9 lines fetched
2019-04-16 10:18:35 0197 ENDSUB
2019-04-16 10:18:35 1263 REM *** *** ***
2019-04-16 10:18:35 1264 working:
2019-04-16 10:18:35 1265 Load * inline [ProxyPackageId,RequestSequenceId]
2019-04-16 10:18:35 2 fields found: ProxyPackageId, RequestSequenceId,
2019-04-16 10:18:35 0 lines fetched
2019-04-16 10:18:35 1266 working_session:
2019-04-16 10:18:35 1267 NoConcatenate Load * Inline [ProxySessionId, LogTimeStamp]
2019-04-16 10:18:35 2 fields found: ProxySessionId, LogTimeStamp,
2019-04-16 10:18:35 0 lines fetched
2019-04-16 10:18:35 1269 REM *** *** *** ****** *** ****** *** *** *** *** *** *** ****** *** *** *** ***
2019-04-16 10:18:35 1270 IF db_v_file = 1 THEN // File logs as source
2019-04-16 10:18:35 1271 CALL logList
2019-04-16 10:18:35 0159 logList:
2019-04-16 10:18:35 0160 LOAD * INLINE [
2019-04-16 10:18:35 0161 logService, logArea, logType, logStart, logAddlFields,logAddlFilter
2019-04-16 10:18:35 0162 Repository, Audit, Security,Timestamp,fieldsAuditSecurity,additionalFilterAuditSecurity
2019-04-16 10:18:35 0163
2019-04-16 10:18:35 0164 ]
2019-04-16 10:18:35 6 fields found: logService, logArea, logType, logStart, logAddlFields, logAddlFilter,
2019-04-16 10:18:35 1 lines fetched
2019-04-16 10:18:35 0165 ENDSUB
2019-04-16 10:18:35 1272 CALL defineFields
2019-04-16 10:18:35 0172 LET fieldsAuditSecurity = ''
2019-04-16 10:18:35 0174 ENDSUB
2019-04-16 10:18:35 1273 CALL multiNodeConfig
2019-04-16 10:18:35 0251 FOR each folder in DirList(archivedLogsFolder & '*')
2019-04-16 10:18:35 Error: Connection not found: ArchivedLogsFolder
2019-04-16 10:18:35 Execution Failed
2019-04-16 10:18:35 Execution finished.

Hi,

I'm getting type of error while running Monitor License task. Please help me to resolve it.

Re: Operations monitor reload task failed due to Connection error

KishoreSuri — Tue, 16 Apr 2019 10:48:03 GMT

In addition to my above post, we have replaced localhost to our server . But still issue exists. Please help us asap.

Re: Operations monitor reload task failed due to Connection error

dx_anupam — Tue, 16 Apr 2019 12:08:30 GMT

Hi,

Below link might help you to get issue fixed

https://help.qlik.com/en-US/sense/February2019/Subsystems/Monitoring/Content/Sense_Monitoring/Troubleshooting/troubleshooting-monitoring.htm

Regards,

Anupam

Re= Operations monitor reload task failed due to Connection error

KishoreSuri — Tue, 16 Apr 2019 12:40:47 GMT

Hi,

Thanks for reply, anyway issue got resolved.

Re: Re= Operations monitor reload task failed due to Connection error

dx_anupam — Tue, 16 Apr 2019 12:51:06 GMT

What solution applied?

Re= Re= Operations monitor reload task failed due to Connection error

KishoreSuri — Tue, 16 Apr 2019 13:00:47 GMT

We added ArchievedLog folder @ c:/programdata/Qlik/Sense/Repository/

Hence, issue resolved.

Also we changed localhost to our server name in each Monitor_Apps* under Data Connections in QMC.

Re: Re= Re= Operations monitor reload task failed due to Connection error

suhasinigs — Mon, 02 Aug 2021 06:02:50 GMT

Hi Kishore,

I have added ArchievedLog folder @ c:/programdata/Qlik/Sense/Repository/,do I need to change the folder connection to?

Thanks and Regards

Suhasini G Metri

Re: Operations monitor reload task failed due to Connection error

nicolaslopedebarrios — Mon, 21 Oct 2024 15:22:18 GMT

In our case, qvd files were corrupted, with some data out of range. You can find out by opening the qvd file pointed out by the error with the viewer.

The issue was resolved by deleting the .qvd and letting them recreate. This worked for every error of this kind:

I/O error filenameLog_7.xx.x_file.qvd: LogContent: NoConcatenate Load * FROM lib://ServerLogFolder/filenameLog_7.xx.x_file.qvd (qvd) WHERE LogTimeStamp >= 'yyyy-mm-dd'