Qlik Community

Ask a Question

QlikView App Dev

Discussion Board for collaboration related to QlikView App Development.

Announcements
Join us at the Cloud Data and Analytics Tour! REGISTER TODAY
cancel
Showing results for 
Search instead for 
Did you mean: 
arulsettu
Master III
Master III

load issue

hi

i am having 20 gb of data. when i load only three fields from a table it taking 1+ hour to load. is there any way to make it fast?

what is the issue?

26 Replies
alexandros17

Too many data, probably you can split in historical data and actual data, in this scenario store the historical data in a qvd (it is faster to reload and concatenate the actual data loaded normally.

Let me know

rbecher
Luminary Alumni
Luminary Alumni

Hi Arul,

what is the source? A csv file or a database?

- Ralf

Vizlib Head of R&D
arulsettu
Master III
Master III
Author

sql

arulsettu
Master III
Master III
Author

storing into optimized qvd?

arulsettu
Master III
Master III
Author

can you give a example?

alexandros17

The following script must be executed once.

History1:

Select * from mytable where year < 2014;

Store * from History1 into TAB_HIS1.qvd;

This is the script you must execute in your document:

FinalTable:

noconcatenate

Load * from TAB_HIS1.qvd;

concatenate

Load * from mytable where year >= 2014;

arulsettu
Master III
Master III
Author

i trying and let u know the result

Not applicable

Hi,

My advice is to use QlikView Deploy Framework to create new qvd-extractor. You have to create QVD for all tables, you will spend a lot of time to do that, but you will do that once time. There are a lot of information about this solution.

Next when you create your first qvd files next qvd files will be created with "Initial Load" or "Delta Load". This will save a lot of time of you, and if you got optimized qvd file to concatenate the initial load , the time will be shorter.

There are a lot of ways for "Initial Load". There are also ready solution for this (for example Qlik Components) , so you have big choice and you have to choose most suitable in your situation.

Regards,

Venelin

ashfaq_haseeb

Hi,

You can apply index at DB level to improve query response time.

Regards

ASHFAQ