Qlik Community

QlikView Scripting

Discussion Board for collaboration on QlikView Scripting.

Announcements
QlikView Fans! We’d love to hear from you.
Share your QlikView feedback with the product team… Click here to participate in our 5-minute survey.
Rules, plus terms and conditions, can be found here.
markgraham123
Contributor II

Incremental Load

Hi all,

I'm a beginner in QlikView.

One of my QlikView application taking couple of hours to load as the data is about past 2 years.

I wanna use Incremental load such that, first load will fetch all the records, and for the rest of the loads - it just brings the data which is newly loaded.

I do have  a Date field.

For eg: I have all the data till 8/9/2015 and i wanna concatenate the data from 8/10/2015 to the existing data.

I was struggling to get the proper expression.

Can someone help here.

Load * from xyz.qvd .

Incremental setup:

Load * from xyz.qvd Where Date>=8/9/2015.

But i wanna load only values which were not present.

1 Solution

Accepted Solutions
neetha_p
Honored Contributor

Re: Incremental Load

Hi Mark,

Try:

Table:

LOAD  Id,

ModifyTime,

FROM Olddata.qvd(qvd);

let vMaxTime = Peek('ModifyTime',-1,'Table');

DROP Table Table;

Details:

  LOAD Id,

      ModifyTime

FROM Newdata.qvd(qvd)

Where ModifyTime > $(vMaxTime);

//Old Data

Concatenate

LOAD Id,

      ModifyTime

FROM Olddata.qvd(qvd);

Modified:

NoConcatenate

LOAD Id,

      ModifyTime

Resident Details Order By ModifyTime asc;

DROP Table Details;

STORE * from Modified into Final.qvd(qvd);

7 Replies
krishna_2644
Valued Contributor III

Re: Incremental Load

www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

This site has some good info on incremental load.

Re: Incremental Load

Load * from xyz.qvd .

Incremental setup:

Load * from xyz.qvd

Where

     Date>=8/9/2015

     And Not Exists(FieldWithExistingValues);


talk is cheap, supply exceeds demand
ecolomer
Honored Contributor II

Re: Incremental Load

See this post:

Incremental Load

neetha_p
Honored Contributor

Re: Incremental Load

Hi Mark,

Try:

Table:

LOAD  Id,

ModifyTime,

FROM Olddata.qvd(qvd);

let vMaxTime = Peek('ModifyTime',-1,'Table');

DROP Table Table;

Details:

  LOAD Id,

      ModifyTime

FROM Newdata.qvd(qvd)

Where ModifyTime > $(vMaxTime);

//Old Data

Concatenate

LOAD Id,

      ModifyTime

FROM Olddata.qvd(qvd);

Modified:

NoConcatenate

LOAD Id,

      ModifyTime

Resident Details Order By ModifyTime asc;

DROP Table Details;

STORE * from Modified into Final.qvd(qvd);

markgraham123
Contributor II

Re: Incremental Load

Thank you everyone.

Arjunarao
Honored Contributor II

Re: Incremental Load

Hi markgraham123

Please select Correct Answer/Helpful as you got the solution. Thank you.

markgraham123
Contributor II

Re: Incremental Load

Sorry for the delay.

Community Browser