topic Re: incremental load in QlikView

incremental load

Anonymous — Wed, 25 Nov 2020 16:16:04 GMT

I am very new to Qlikview and would like to do incremental load based on the latest time stamp in QVD file.

I stored the initial data on QVD file that has a few columns, where column A is Time Stamp. I sorted the time stamp in the QVD just to ensure all time stamps are in order with below script.

Initial_Data:

LOAD [Time Stamp], B,C,D,E,F

FROM

$(vQVDSave)Initial_data.qvd

(qvd);

Sorted_Record:

LOAD *

Resident Initial_Data

order by [Time Stamp];

LET vLatestRecord = Peek('[Time Stamp]', -1, 'Sorted_Record');

Drop table Initial_Data;

//Load new Records

Latest_Data:

LOAD [Time Stamp], B,C,D,E,F

FROM $(vDataSource) filename.csv

(txt, codepage is 1252, embedded labels, delimiter is ',', msq)

Where [Time Stamp] > $(vLatestRecord);

It did not work properly when I reloaded it and keep showing error message

Field not found - <>>

Latest_Data:

LOAD Filed Names....

FROM

where [Time Stamp] >

Any clue? Appreciate any suggestion from the experts in this forum to fix this.

Re: incremental load

Silambarasan1306 — Wed, 25 May 2016 09:22:57 GMT

Hi Fikri Shihab,

Did u got the output what u expected..??

pls post the code.

Re: incremental load

Anonymous — Wed, 25 May 2016 14:15:36 GMT

I might have posted a separate discussion on this. You may want to take alook at this. It is solved.

time stamp driven incremental load

Re: incremental load

ziadm — Wed, 25 May 2016 14:45:03 GMT

There error mainly because you loading two smillar structure table(Initial_Data and Sorted_Record) as a result they get concatenated. Then you drop the Table Initial_Data and that is why the error message comes

use the NoConcatenate statement after Intial_Data Load to correct the error

everything you need to learn on incremental load

Incremental Load in Qlikview - Sources

Re: incremental load

Anonymous — Wed, 25 May 2016 23:31:12 GMT

Thanks for the link. Very useful!

Re: incremental load

Silambarasan1306 — Thu, 26 May 2016 04:55:19 GMT

Thank You

Re: incremental load

Thu, 26 May 2016 05:11:09 GMT

Hi,

Try this,

Initial_Data:

LOAD [Time Stamp], B,C,D,E,F

FROM

$(vQVDSave)Initial_data.qvd

(qvd);

Latest_Rec:

LOAD max([Time Stamp]) as Latest_Record

Resident Initial_Data;

LET vLatestRecord = Peek('Latest_Record', 0, 'Latest_Rec');

Drop table Latest_Rec;

Latest_Data:

LOAD [Time Stamp], B,C,D,E,F

FROM $(vDataSource) filename.csv

(txt, codepage is 1252, embedded labels, delimiter is ',', msq)

Where [Time Stamp] > $(vLatestRecord);

-Joyson G

Re: incremental load

oknotsen — Thu, 26 May 2016 07:18:20 GMT

If your question is now answered, please flag the Correct Answer.

If not, please make clear with what part of this question you still need help .