topic Re: how to reduce reload time in QlikView

how to reduce reload time

Wed, 30 Jul 2014 11:43:39 GMT

i have a qlikview application which is 4 GB size and reload time is 6 hours now i want to reduce the reload time how to reduce...?

Re: how to reduce reload time

tobias_klett — Wed, 30 Jul 2014 11:47:46 GMT

Hi Mahesh,
use QVD-files and incremetal load. Check QlikView Help for "QVD files and Incremental Load"

Hope this helps
Tobias

Re: how to reduce reload time

rustyfishbones — Wed, 30 Jul 2014 11:50:35 GMT

You will need to create Incremental Loads and create QVD layers for Extraction and Transformation of Data.

Then only load the final transformed QVD's into the final Qlikview Application

There are videos on Youtube that will guide you through this

Alan

Re: how to reduce reload time

datanibbler — Wed, 30 Jul 2014 11:50:43 GMT

Hi,

a possible fix - not really a solution, but it moves the load to another time - is to use "QlikMarts" - qvw_files where you load all the data (from qvd_files if possible like Tobias said) and which you can then load BINARY into your app.

HTH

Best regards,

DataNibbler

Re: how to reduce reload time

fkeuroglian — Wed, 30 Jul 2014 12:29:41 GMT

Hi, you have to use Incremental load

Hope this helps

http://www.learnallbi.com/incremental-load-in-qlikview-part1/

Fernando

Re: how to reduce reload time

Mon, 04 Aug 2014 07:44:43 GMT

Also, take into consideration optimizing the load script. Use mapping loads and apply map instead of joins when possible.

http://community.qlik.com/blogs/qlikviewdesignblog/2012/09/18/one-favorite-function-applymap

Load only the data that you are going to use (check for unused fields or tables).

Check it with this: Document Analyzer 1.14

If possible, try having on the database some of the calculations that you currently do on the load script.

This are some tips that can speed up the load and require less resources from the server.

Re: how to reduce reload time

jagan — Mon, 04 Aug 2014 08:00:18 GMT

Hi Mahesh,

If you want to reduce the reload time then try this various options

1. Don't use * in Select or Load statement, specify only the fields which you are using in Dashboard.

2. Load only the data which you are using for analyis, for example if you have 20 years of data and if you are using only last 5 years of data then load only those data.

3. Do all the calculations in Qlikview scripting instead of doing it in Select Query.

4. Make sure that required indexes are there in the Database tables, if there is no index then perform would be slower.

5. If data is huge try to imlement Incremental loading concept.

6. Do all your transformations in Qlikview if possible.

7. Try to avoid Snowflake schema.

Hope this helps you.

Regards,

Jagan.