load issue

[arulsettu]

hi

i am having 20 gb of data. when i load only three fields from a table it taking 1+ hour to load. is there any way to make it fast?

what is the issue?

[alexandros17]

Too many data, probably you can split in historical data and actual data, in this scenario store the historical data in a qvd (it is faster to reload and concatenate the actual data loaded normally.

Let me know

[rbecher]

Hi Arul,

what is the source? A csv file or a database?

- Ralf

[arulsettu]

sql

[arulsettu]

storing into optimized qvd?

[arulsettu]

can you give a example?

[alexandros17]

The following script must be executed once.

History1:

Select * from mytable where year < 2014;

Store * from History1 into TAB_HIS1.qvd;

This is the script you must execute in your document:

FinalTable:

noconcatenate

Load * from TAB_HIS1.qvd;

concatenate

Load * from mytable where year >= 2014;

[arulsettu]

i trying and let u know the result

[#9]

Hi,

My advice is to use QlikView Deploy Framework to create new qvd-extractor. You have to create QVD for all tables, you will spend a lot of time to do that, but you will do that once time. There are a lot of information about this solution.

Next when you create your first qvd files next qvd files will be created with "Initial Load" or "Delta Load". This will save a lot of time of you, and if you got optimized qvd file to concatenate the initial load , the time will be shorter.

There are a lot of ways for "Initial Load". There are also ready solution for this (for example Qlik Components) , so you have big choice and you have to choose most suitable in your situation.

Regards,

Venelin

[ashfaq_haseeb]

Hi,

You can apply index at DB level to improve query response time.

Regards

ASHFAQ