Qlik Community

QlikView Creating Analytics

Discussion Board for collaboration related to Creating Analytics for QlikView.

Not applicable

how to reduce reload time

i have a qlikview application which is 4 GB size and reload time is 6 hours now i want to reduce the reload time how to reduce...?

6 Replies
tobias_klett
Contributor II

Re: how to reduce reload time

Hi Mahesh,
use QVD-files and incremetal load. Check QlikView Help for "QVD files and Incremental Load"

Hope this helps
Tobias

rustyfishbones
Honored Contributor II

Re: how to reduce reload time

You will need to create Incremental Loads and create QVD layers for Extraction and Transformation of Data.

Then only load the final transformed QVD's into the final Qlikview Application

There are videos on Youtube that will guide you through this

Alan

datanibbler
Esteemed Contributor

Re: how to reduce reload time

Hi,

a possible fix - not really a solution, but it moves the load to another time - is to use "QlikMarts" - qvw_files where you load all the data (from qvd_files if possible like Tobias said) and which you can then load BINARY into your app.

HTH

Best regards,

DataNibbler

Partner
Partner

Re: how to reduce reload time

Hi, you have to use Incremental load

Hope this helps

http://www.learnallbi.com/incremental-load-in-qlikview-part1/

Fernando

Not applicable

Re: how to reduce reload time

Also, take into consideration optimizing the load script. Use mapping loads and apply map instead of joins when possible.

http://community.qlik.com/blogs/qlikviewdesignblog/2012/09/18/one-favorite-function-applymap

Load only the data that you are going to use (check for unused fields or tables).

Check it with this: Document Analyzer 1.14

If possible, try having on the database some of the calculations that you currently do on the load script.

This are some tips that can speed up the load and require less resources from the server.

MVP & Luminary
MVP & Luminary

Re: how to reduce reload time

Hi Mahesh,

If you want to reduce the reload time then try this various options

1. Don't use * in Select or Load statement, specify only the fields which you are using in Dashboard.

2. Load only the data which you are using for analyis, for example if you have 20 years of data and if you are using only last 5 years of data then load only those data.

3. Do all the calculations in Qlikview scripting instead of doing it in Select Query.

4. Make sure that required indexes are there in the Database tables, if there is no index then perform would be slower.

5. If data is huge try to imlement Incremental loading concept.

6. Do all your transformations in Qlikview if possible.

7. Try to avoid Snowflake schema.

Hope this helps you.

Regards,

Jagan.