monitoring load time performance

[ilanbaruch]

hi all,

I have 8 models on QV server and I want to monitor daily load time,

each model holds a variable for start time and I can see the daily load duration (reloadtime()-vStartTime) in the model.

any idea how to create a model that will gather all variables or is there an option to see this info on server management console?

advanced thanks.

[Anonymous]

At the end of the script create / append to a QVD file fields containing :

• QVW file name
• Reload start time
• Reload end time
• Any other useful information such as rows processed / saved to qvd etc....

This QVD can then be used as input to a qvw dashboard to analyse reload stats.

[Colin-Albert]

If you click on Show Task Details in the QMC Status page, (top right corner), you can see some stats on reload times such as average time, and the Task History shows details of the time and result of past runs.

Otherwise generate a QVD in your load scripts as bill.markham suggests and create your own report.

[ilanbaruch]

thank you,

another Q:

if I place in every model the relevant info fields  and store them into QVD it will overwrite the previous day QVD and will hold only the current, is that correct?

[Anonymous · Accepted solution]

You will need to do an incremental load of the qvd :

• Load qvd into resident table
• Concatenate you new stats data onto this resident table
• Store your qvd from the resident table

Here is a good blog post describing this and other incremental load scenarios,

     http://www.quickintelligence.co.uk/qlikview-incremental-load/

[ilanbaruch]

Bill, Thank you very much.

[quwok]

To give you another option. If you enable "Generate Logfile" and "Timestamp in Logfile Name" on each of your document, you should get a log file of every reload in the folder where the QlikView document is located.

You could then create a QlikView document to get the details from the logs.

This will be more work initially, but as you develop it further, you should be able to get a lot more analytics and even look into timings of sections of the load.

[ilanbaruch]

thank you,

you think it will effect app performance?

[Colin-Albert]

I would not recommend using the timestamp in the logfile name by default as this will create a separate file each time a reload is run and you will need to manage those manually, to prevent adding a lot of clutter to the folder where the QVWs reside.

The QDS service saves logs for the past month if the Generate Logfile is enabled.

The logs are in the ProgramData\QlikTech\DistributionService\1\Logs folder with a sub-folder for each day.