topic Re: Incremental Load in QlikView

Incremental Load

markgraham123 — Tue, 11 Aug 2015 14:34:02 GMT

Hi all,

I'm a beginner in QlikView.

One of my QlikView application taking couple of hours to load as the data is about past 2 years.

I wanna use Incremental load such that, first load will fetch all the records, and for the rest of the loads - it just brings the data which is newly loaded.

I do have a Date field.

For eg: I have all the data till 8/9/2015 and i wanna concatenate the data from 8/10/2015 to the existing data.

I was struggling to get the proper expression.

Can someone help here.

Load * from xyz.qvd .

Incremental setup:

Load * from xyz.qvd Where Date>=8/9/2015.

But i wanna load only values which were not present.

Re: Incremental Load

Qrishna — Tue, 11 Aug 2015 14:37:00 GMT

www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

This site has some good info on incremental load.

Re: Incremental Load

Gysbert_Wassenaar — Tue, 11 Aug 2015 14:38:42 GMT

Load * from xyz.qvd .

Incremental setup:

Load * from xyz.qvd

Where

Date>=8/9/2015

And Not Exists(FieldWithExistingValues);

Re: Incremental Load

ecolomer — Tue, 11 Aug 2015 14:39:55 GMT

See this post:

Incremental Load

Re: Incremental Load

Anonymous — Tue, 11 Aug 2015 14:46:29 GMT

Hi Mark,

Try:

Table:

LOAD Id,

ModifyTime,

FROM Olddata.qvd(qvd);

let vMaxTime = Peek('ModifyTime',-1,'Table');

DROP Table Table;

Details:

LOAD Id,

ModifyTime

FROM Newdata.qvd(qvd)

Where ModifyTime > $(vMaxTime);

//Old Data

Concatenate

LOAD Id,

ModifyTime

FROM Olddata.qvd(qvd);

Modified:

NoConcatenate

LOAD Id,

ModifyTime

Resident Details Order By ModifyTime asc;

DROP Table Details;

STORE * from Modified into Final.qvd(qvd);

Re: Incremental Load

markgraham123 — Tue, 11 Aug 2015 14:49:47 GMT

Thank you everyone.

Re: Incremental Load

qlikviewwizard — Wed, 12 Aug 2015 06:09:42 GMT

Hi markgraham123

Please select Correct Answer/Helpful as you got the solution. Thank you.

Re: Incremental Load

markgraham123 — Wed, 12 Aug 2015 15:14:52 GMT

Sorry for the delay.