Solved: Re: Incremental Load - Qlik Community

Anonymous · ‎2017-09-26

Hi

I have following sales data going back to year 2014. The actual model i have takes an hour to reload as it reloads all the data. I want to reduce the reload time by applying incremental reload. How do i accomplish this. Basically, the incremental reload should be the last sales date.

Attached herewith is the data.

Kind regards

Nayan

its_anandrjs · ‎2017-09-26

Check the attached file

First initially load all data and then incremental load data with max date by finding max date by variables and then comment initial load table.

MaxDateTab:

LOAD Date(Max(Date)) as MaxDate FROM SalesData.qvd(qvd);

LET vMaxDate = Peek('MaxDate',0,'MaxDateTab');

//Incremental Load

Data:

LOAD Date,

[Sales Amount]

FROM

[Sales Data.xlsx]

(ooxml, embedded labels, table is Sheet1)

Where Date > '$(vMaxDate)';

Concatenate(Data)

LOAD * FROM SalesData.qvd(qvd);

Store Data into SalesData.qvd;

DROP Table Data;

View solution in original post

prma7799 · ‎2017-09-26

Please check this

https://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

QlikView Incremental Load

Incremental load in Qlikview

prma7799 · ‎2017-09-26

Also go through this

Anonymous · ‎2017-09-26

Thank you. Will let you know if I'm successful.

Kind regards

Nayan

prma7799 · ‎2017-09-26

Ok ... Good.

its_anandrjs · ‎2017-09-26

Check the attached file

First initially load all data and then incremental load data with max date by finding max date by variables and then comment initial load table.

MaxDateTab:

LOAD Date(Max(Date)) as MaxDate FROM SalesData.qvd(qvd);

LET vMaxDate = Peek('MaxDate',0,'MaxDateTab');

//Incremental Load

Data:

LOAD Date,

[Sales Amount]

FROM

[Sales Data.xlsx]

(ooxml, embedded labels, table is Sheet1)

Where Date > '$(vMaxDate)';

Concatenate(Data)

LOAD * FROM SalesData.qvd(qvd);

Store Data into SalesData.qvd;

DROP Table Data;

Anonymous · ‎2017-09-26

Thank you Anand for your reply, i will let you know.

By the way, on the Incremental Load Script, will it be better to use an " Where Exist" expression as it will only look at the max date reload data and as compared to just a "Where" Expression, where it will load all data and then reduce to a max date. Am I correct?

Kind regards

Nayan

its_anandrjs · ‎2017-09-26

Exactly but in your requirement you are want to load the data with Maxdate which is Max date for one day, Right. so in this you have to find only Max Date and load your latest available dates from the table and concatenate with the previous (History Qvd).

Anonymous · ‎2017-09-26

Thank you for the feedback. Will the reload time be shorter?

Kind regards

Nayan

Anonymous · ‎2017-09-26

Hi Anand

The reload time is shorter.

Kind regards

Nayan