Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
markgraham123
Specialist
Specialist

Incremental Load

Hi all,

I'm a beginner in QlikView.

One of my QlikView application taking couple of hours to load as the data is about past 2 years.

I wanna use Incremental load such that, first load will fetch all the records, and for the rest of the loads - it just brings the data which is newly loaded.

I do have  a Date field.

For eg: I have all the data till 8/9/2015 and i wanna concatenate the data from 8/10/2015 to the existing data.

I was struggling to get the proper expression.

Can someone help here.

Load * from xyz.qvd .

Incremental setup:

Load * from xyz.qvd Where Date>=8/9/2015.

But i wanna load only values which were not present.

1 Solution

Accepted Solutions
Anonymous
Not applicable

Hi Mark,

Try:

Table:

LOAD  Id,

ModifyTime,

FROM Olddata.qvd(qvd);

let vMaxTime = Peek('ModifyTime',-1,'Table');

DROP Table Table;

Details:

  LOAD Id,

      ModifyTime

FROM Newdata.qvd(qvd)

Where ModifyTime > $(vMaxTime);

//Old Data

Concatenate

LOAD Id,

      ModifyTime

FROM Olddata.qvd(qvd);

Modified:

NoConcatenate

LOAD Id,

      ModifyTime

Resident Details Order By ModifyTime asc;

DROP Table Details;

STORE * from Modified into Final.qvd(qvd);

View solution in original post

7 Replies
krishna_2644
Specialist III
Specialist III

www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

This site has some good info on incremental load.

Gysbert_Wassenaar

Load * from xyz.qvd .

Incremental setup:

Load * from xyz.qvd

Where

     Date>=8/9/2015

     And Not Exists(FieldWithExistingValues);


talk is cheap, supply exceeds demand
ecolomer
Master II
Master II

See this post:

Incremental Load

Anonymous
Not applicable

Hi Mark,

Try:

Table:

LOAD  Id,

ModifyTime,

FROM Olddata.qvd(qvd);

let vMaxTime = Peek('ModifyTime',-1,'Table');

DROP Table Table;

Details:

  LOAD Id,

      ModifyTime

FROM Newdata.qvd(qvd)

Where ModifyTime > $(vMaxTime);

//Old Data

Concatenate

LOAD Id,

      ModifyTime

FROM Olddata.qvd(qvd);

Modified:

NoConcatenate

LOAD Id,

      ModifyTime

Resident Details Order By ModifyTime asc;

DROP Table Details;

STORE * from Modified into Final.qvd(qvd);

markgraham123
Specialist
Specialist
Author

Thank you everyone.

qlikviewwizard
Master II
Master II

Hi markgraham123

Please select Correct Answer/Helpful as you got the solution. Thank you.

markgraham123
Specialist
Specialist
Author

Sorry for the delay.