Skip to main content
Announcements
Join us at Qlik Connect for 3 magical days of learning, networking,and inspiration! REGISTER TODAY and save!
cancel
Showing results for 
Search instead for 
Did you mean: 
mudanhong
Contributor II
Contributor II

How to reload latest QVD file only after click 'Load Data' button

Below is my incremental loading script:

Test:

Load

*

where primary key>'xxx';

select * FROM CSV (header on, delimiter ",", quote """") "abc"

WITH CONNECTION (Url "$(vUrl1)");

concatenate load

from abc.qvd

where not exists(primary key);

This only works for avoiding duplicate calculating for the whole abc.qvd each now I start this app task. 

But if there is any way that I can only load latest qvd into app RAM rather than loading the whole year QVD file data into app RAM again? I means if there is a way that app could keep the previous run qvd data in RAM and only load required latest data onto the old data in app RAM?

Test:

Load

*

from abc_2021.02.02.qvd;//2021.02.02 should be defined as latest date

10 Replies
mudanhong
Contributor II
Contributor II
Author

Below is my code to load abc data: But 'Select' time almost cost much less time than loading abc_total.qvd since abc_total.qvd contains all the historical data that is huge.  

Let ThisExecDate = Date(now(),'YYYY.MM.DD');
Trace ThisExecDate :$(ThisExecDate );

Total:
LOAD
*
FROM [lib://PROD QVDFiles/abc_$(ThisExecDate).qvd](qvd)
where abcname<>'123456';

Concatenate LOAD
*
FROM [lib://PROD QVDFiles/abc_Total\abc_Total.qvd](qvd)
where not Exists(abcId);

store Total into [lib://PROD QVDFiles/abc_Total\abc_Total.qvd];

drop table Total,Exclude;