topic Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log in Management & Governance

Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

jeroen_wagner — Thu, 08 Oct 2015 07:16:56 GMT

Hello,

I have a customer who has %Gig of log files in ProgramData\Qlik\Sense\Log

I've adviced to delete it for now, as I don't see any problems doing so, but some questions remain.

Why does Sense create so many log files (keeping them all)
How can I limit this

thanx

Attached a log file from my own laptop... not showing much shcoking....

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

jeroen_wagner — Thu, 08 Oct 2015 07:47:18 GMT

And here one of the customers log files...

As you can see, nothing more than te script execution.

But why keep all those log files

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

Tyler_Waterfall — Mon, 19 Oct 2015 16:45:10 GMT

Jeroen, this is an open question for Sense - something I've asked about in terms of at least setting the script log verbosity by app or globally. I am not aware of any way presently to stop those time-stamped script logs from being created.

For now, I just manually delete those script log files in Qlik\Sense\Log\Script.

In a later version 2.x I believe those logs get archived to the Qlik\Sense\Repository\Archived Logs\[SERVERNAME]\Script folder.

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

awqvuserneo — Tue, 05 Jan 2016 00:17:07 GMT

Hi Tyler,

Instead of manually deleting the logs in C:\PRogramData\Qlik\Sense\Repository\Archived Logs\[SERVERNAME]\Script folder, I created a similar folder structure in a different drive (D:\ProgramData\Qlik\...).

To have the log files being tracked accordingly by Qlik Engine, I modified the "Connection String" value within QMC, to point to Drive D with the same folder structure.

BEFORE:

AFTER

I would expect the new logs will now being created in Drive D, however, that is not the case (New logs are still being generated within "Script" folder of drive C). Is there something that I miss? (I've already restarted all the Qlik Sense Services upon changing the value above).

I appreciate your feedback on this,

Cheers,

Anton

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

Tyler_Waterfall — Tue, 05 Jan 2016 13:52:03 GMT

Hello Anton,

The data connections "ServerLogFolder" and "ArchivedLogsFolder" in the QMC are only used by the Monitoring Apps - the Operations Monitor and License Monitor - and do not impact where any Qlik Sense services write their logs but where these apps look for log files.

I am not aware of any way in the QMC to change where these logs are written. As I understand it, that path is set during Sense Server installation.

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

awqvuserneo — Tue, 05 Jan 2016 14:27:53 GMT

Hi Tyler,

Thank you for your respond. I guess you're right, because this setting is only located at "Data Connection", of which you usually use to connect to your data sources. I'm hoping the Archived Logs is a bit different because it's automatically created when Qlik Sense is being installed, I guess I'm wrong.

Probably what I should do in the first place, is to have the Qlik Sense installed on Drive D, therefore all the Archived Logs will be installed on Drive D as well. OR, maybe I can re-install the Qlik Sense on Drive D now, even though I'm a bit hesitant doing so (Last time I did it with Qlik Sense 1.0, something stop working).

Anyway, thank you for your input, I appreciate it.

Best regards,

Anton

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

Anonymous — Mon, 26 Sep 2016 14:14:28 GMT

Hi Jeroen,

What I've done to prevent the C-drive filling up is:

Create a new directory on your D-drive, e.g. D:\QlikSenseArchivedLogs
Stop your Qlik Sense services
Move C:\ProgramData\Qlik\Sense\Repository\Archived Logs\YOURHOSTNAME to D:\QlikSenseArchivedLogs\YOURHOSTNAME. This might be a good moment for a coffee break .
Open a command prompt (elevated, which is default in Windows Server 2012 R2)
Go to C:\ProgramData\Qlik\Sense\Repository\Archived Logs\:
cd "C:\ProgramData\Qlik\Sense\Repository\Archived Logs\"
Create a directory junction:
mklink /J YOURHOSTNAME D:\QlikSenseArchivedLogs\YOURHOSTNAME
Try to navigate in Explorer from C:\ProgramData\Qlik\Sense\Repository\Archived Logs\ to YOURHOSTNAME, just to be sure.
Start your Qlik Sense services

#TryThisOnYourTestServerFirstOfCourse

Best regards,

Egbert

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

jeroen_wagner — Wed, 05 Oct 2016 08:43:43 GMT

Thanx Egbert,

The best solution though remains clearing out the old logs every once in a while...
Hopefully the QMC will come with an option to keep logs for a certain period that you can set...

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

RSvebeck — Thu, 27 Oct 2016 08:55:42 GMT

I solved this problem with creating an app that runs once per day and clears out old log files :

---------------

Sub DeleteOldFiles (vPath,vNoOfDaysToKeep)
LET command = 'forfiles /P $(vPath) /S /M *.* /D -$(vDaysToKeep) /C "cmd /c del @PATH"';
execute cmd.exe /c "$(command)" ;
End Sub;

Call DeleteOldFiles ('"C:\ProgramData\Qlik\Sense\Repository\Archived Logs\.....\Script\"',30);

------------

This solution requires the EXECTUE command to be allowed on your Sense server. If you do not want that, then just create a scheduled task with windows scheduler that runs this as a batch-command for auto delete of logfiles 30 Days or older:

forfiles /P "C:\ProgramData\Qlik\Sense\Repository\Archived Logs\.....\Script\" /S /M *.* /D -30 /C "cmd /c del @PATH"

brg Robert

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

awqvuserneo — Mon, 07 Nov 2016 18:24:15 GMT

Robert,

Thank you for sharing the "workaround".

Cheers,

Anton

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

yadav_anil782 — Mon, 11 Jun 2018 08:39:58 GMT

Hello Anton,

i have also the same situation and a am trying to Use your script for deleting the more then 90 days logs file automatically from log folder but i am not getting success.

currently i am using below scipt.

'forfiles /P "C:/ProgramData/Qlik/Sense/Log/Temp/S/M *.*/D -90 /C "cmd /c del @path" ';

could you please guide me if i need to change something in script

Many thanks in Advance

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

awqvuserneo — Fri, 22 Jun 2018 13:07:10 GMT

Hi Anil,

Sorry for the late respond. Have you had a chance to make it work? I would modify the code as follows: reverse the folder separator, and put a space between /Temp /S /M

Note:(I haven't fully tested it though).

forfiles /P "C:\ProgramData\Qlik\Sense\Log\Temp" /S /M *.* /D -90 /C "cmd /c del @path"

-Anton

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

yadav_anil782 — Mon, 02 Jul 2018 12:28:24 GMT

Hello Anton ,

i applied below script and it is working fine.

forfiles /p "E:\QlikSenseSharedData\Archived Logs" /s /m *.log* /D -180 /C "cmd /c del @path"

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

yadav_anil782 — Mon, 02 Jul 2018 12:28:41 GMT

Hello Anton ,

i applied below script and it is working fine.

forfiles /p "E:\QlikSenseSharedData\Archived Logs" /s /m *.log* /D -180 /C "cmd /c del @path"

Re: Sense: 5Gig of logs in: ProgramData\Qlik\Sense\Log

gustavgager — Thu, 05 Jul 2018 07:38:04 GMT

This is the best "solution" in my opinion.

I created a small script that runs every day and deletes all log files older the n two weeks. Otherwise my c: drive would fill up.

Qlik should add the ability to auto-delete logs.