Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Optimization of time reload

Hello everyone,

I made some Qlikview report which load data from several Excel files. Files contain large amount of data and Qlikview load them more than 7 minutes. My problem is if I change one number in some Excel file I need to reload all data again and wait new 7 minutes.

What are my opportunitis of optimization loading data and time reduction? Can I ask somehow if only one Excel file changed to load again only him, or is there any incremental load?

Thanks for any help

3 Replies
Not applicable
Author

Not sure if this is the best solution, but something I do in some apps is use a series of variables to control whether I am loading from the source file or from a buffered QVD that was created during the last load.

//First the variables that control which tables I am refreshing (in the below scenario, only Table2 will refresh from source):

SET Load_From_QVDS                   = 0; //1 = Load ALL Tables from QVD's, 0 = Set by table below

SET Load_Table1                            = 1; //1 = Load from QVD, 0 = From Source

SET Load_Table2                            = 0; //1 = Load from QVD, 0 = From Source

SET Load_Table3                            = 1; //1 = Load from QVD, 0 = From Source

//Then for each table you would have some loading script that looks like:

If Load_From_QVDS = 1 or Load_Table1 = 1 THEN

Table1:

LOAD *

FROM

QVD\Table1.qvd

(qvd);

ELSE

Table1:

LOAD *

FROM

Source\Table1.xlsx

(ooxml, embedded labels, table is Table1);

STORE TRX INTO [QVD\Table1.qvd];

ENDIF

marcus_sommer

You could look here - http://community.qlik.com/search.jspa?q=incremental+load - if an incremental load could be useful - if not because there isn't any real logic which data has changed you could read & store the filetime() from the excel. If the filetime the same how from previous load then you could load from the qvd else from the xls.

- Marcus

Not applicable
Author

Tnx Marcus,

I was thinking on something like that. If I could read file time and if that time is the same from the previous load, i will skip that or load qvd file. I've never done anything like that, but i will try.