Incremental Load

[markgraham123]

Hi all,

I'm a beginner in QlikView.

One of my QlikView application taking couple of hours to load as the data is about past 2 years.

I wanna use Incremental load such that, first load will fetch all the records, and for the rest of the loads - it just brings the data which is newly loaded.

I do have  a Date field.

For eg: I have all the data till 8/9/2015 and i wanna concatenate the data from 8/10/2015 to the existing data.

I was struggling to get the proper expression.

Can someone help here.

Load * from xyz.qvd .

Incremental setup:

Load * from xyz.qvd Where Date>=8/9/2015.

But i wanna load only values which were not present.

[Qrishna]

www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

This site has some good info on incremental load.

[Gysbert_Wassenaar]

Load * from xyz.qvd .

Incremental setup:

Load * from xyz.qvd

Where

     Date>=8/9/2015

     And Not Exists(FieldWithExistingValues);

[ecolomer]

See this post:

Incremental Load

[Anonymous · Accepted solution]

Hi Mark,

Try:

Table:

LOAD  Id,

ModifyTime,

FROM Olddata.qvd(qvd);

let vMaxTime = Peek('ModifyTime',-1,'Table');

DROP Table Table;

Details:

  LOAD Id,

      ModifyTime

FROM Newdata.qvd(qvd)

Where ModifyTime > $(vMaxTime);

//Old Data

Concatenate

LOAD Id,

      ModifyTime

FROM Olddata.qvd(qvd);

Modified:

NoConcatenate

LOAD Id,

      ModifyTime

Resident Details Order By ModifyTime asc;

DROP Table Details;

STORE * from Modified into Final.qvd(qvd);

[markgraham123]

Thank you everyone.

[qlikviewwizard]

Hi markgraham123

Please select Correct Answer/Helpful as you got the solution. Thank you.

[markgraham123]

Sorry for the delay.