Jose - This is a known issue with the timing of when certain logs are written after a service or machine restart. A fix has been identified but will not be available until the next service release.
The workaround for now is to remove the malformed log files mentioned in the data load logs, specifically:
where ServerLogFolder is the folder where the primary Log files are stored (default is c:\programdata\qlik\sense\log)
I also had trouble reloading the monitors. I removed the files you mentioned, but the reload tasks found errors with other 32 files in the lib://ArchivedLogsFolder folders:
Apparently this bug affected all the archived logs generated between the update to v2.0.1 and the fix you mentioned for the ServerLogFolder...
Unfortunately, the bug we are discussing (that you are experiencing) will show itself anytime services are restarted. So, if you have multiple service restarts, it is possible that a malformed log will be created which will cause the apps to fail in reload.
The next SR will have the fix to this logging, but those bad logs will still need to be removed even after the fix.
The next version of the Monitoring Apps will handle these malformed logs better (i.e. not fail on reload!) but the delivery date for updated apps has not been defined yet.
If this is becoming impossible to deal with and you cannot wait for the SR, you can modify the load script and include SET errormode=0; before the few load .... from statements in both apps. Duplicate the apps, open the copies in the Hub and make the changes, and then published those apps to the monitoring apps stream (can replace the existing apps). This is far from ideal and would not be 'supported', but it pains me to think of your inability to use the apps
I am from a partner and I've encountered this problem in my test environment, so fortunately for me this won't be such a big deal.
The next SR you are talking about is the one expected to be released in September?
I really appreciate your comments. For me it's ok, but it will sure help other people with Prod environments and a real need to use the monitoring apps.
Fernando - Yes, the next service release 2.0.2 includes a fix to the logs to prevent these malformed logs. I am not sure when this SR is planned for release, though I would guess in the next few weeks.
Also, as I shared with Jose, the next release of the apps (not in the 2.0.2 service release) will handle reload issues in a more robust manner. Again it is not clear to me when 2.1 will be released.
I've removed the "malformed" files including historical ones and it is working. Many thanks for the guidance. However, I am getting a new error, very uncommon, by the way, Field not found - <Id_temp> in the license monitor app. It's happening when the sub contacttables is called for "LogContent" as concatToTable and "Working" as IncrementalTable; the contactField is getting an error when the sub is creating the $(concatField)_temp
Please, see the log attached
Many thanks for your answer,
Reload License Monitor.log 72.8 K
Hola Jose -
I have seen this reload error but it is usually just when I have either turned off all Qlik services and reload the app two times (no new log entry has been generated) or when I copy log folders to a local drive for testing and then reload the app twice. The reason is that there is not a single new log entry to be found and the load script does not handle that situation well.
The next release of the Monitoring apps will include a few updates to the load script to handle this and other unexpected situations with the logs.
Can you tell me - when are you seeing this reload error? Just reloading the app from QMC? Or in a duplicate app or other scenario?
The reload error was after I've deleted the malformed files, and I have to restart the services for a proxy change. The reloading task shows me the error sent. I’ve just decided stop the task, disable for a while and then enable it and run it again. Right now is working scheduled without a problem!
tnx Tyler Waterfall
License montor works
I stopped the service, added to his right ntfs and removed two files
AuditActivity_Engine.txt and QixCounter_Engine.txt
but Operation monitor reload failed with error
Error: Field not found - <ProxyPackageId>
2015-07-18 23:03:18 General Script Error
2015-07-18 23:03:18 Execution Failed
2015-07-18 23:03:18 Execution finished.
What can I fix it?
Even with the upgrade you need to remove any bad log files from 2.0.1 or you will continue to get the error. Once the bad files are deleted, you will not experience the issue again.
The next release of the Monitoring Apps will make it so that you do not have to remove bad log files, but this improvement was not part of 2.0.2.
Had this issue as well, together with too much errors regarding connection lost with the Sense Engine.
So I started to do everything described in this thread. That took a lot of work and longer than I'd hoped...
- Removed all of the log files that both monitors complained about
- Updated Sense Server to 2.0.2
After that update, almost all my reload tasks failed with the notification "App is not enabled".
Unclear what that means during this step; but after finishing it's clearly stated in the (44-page) installation guide.
Strange to me that only the License Monitor and my LDAP sync tasks succeeded.
- A hint was a yellow indicator in the QMC next to the "Apps" menu button
Turns out, after close inspection and some random clicking-around...
Applications have to be Migrated! There's an action button that I can't remember seeing before.
Probably my fault rushing through the server update and not reading the entire installation guide.
- So I migrated an application, just to see what happens...
Including the Operations Monitor! Which is kindof strange, but okay.
That worked! "Successfully migrated selected apps"
The Yellow indicator next to the "Apps" menu item counted down with 1.
Using the column selector I could select the column "Migration status"
All except one finished within a second.
That other one is going on for 10 minutes already, let's see what happens there.
- And now the reload tasks for the migrated apps work!
- Also there are now two new monitor applications added; with the suffix "_18.104.22.168"
There's even a third License monitor "_22.214.171.124", can't remember if that was already there before the update to 2.0.2
- Server is updated to 2.0.2 SR.
- Monitor apps reload and work, although a lot of history is lost.
- Other apps are migrated (1 still ongoing), reload and are accessible.
We have run into the same issue with our Qlik Sense installation. Both of the monitoring applications' tasks failed to complete and the task logs identified various log files as the issue. It may be helpful for others or Tyler to know that we started off with 1.0.0 but made in place updates from 1.0.0 to 1.1.0, then 2.0.0 and finally 2.0.2. After upgrading to the latest version we removed the following set of log files and we were able to successfully run the reload tasks:
- All content in C:\ProgramData\Qlik\Sense\Log\Engine
Thanks for the post Aaditya.
We have found similar results in house and have a fix for this upgrade-specific issue.
The root problem here is that some services were writing a log file improperly when restarted (fixed with 2.0.2). Even if you upgraded to 2.0.2, those old, bad logs were left behind and would cause problems. With the next release of the Monitoring Apps, the apps won't fail to reload when they encounter these bad logs.
We are on 2.0.1
My rep is going to have a tech specialist get on our system tomorrow to make sure everything is setup and look at the logs. I think we need to do the upgrade