topic Need help to do inc load in QlikView

Need help to do inc load

soniasweety — Sat, 16 Nov 2024 21:08:12 GMT

Hi all, @sunny_talwar

kaushik_solanki

i have data like attached . i want to incremental load in Qlikview with this data

Day is the date field how to do this?

thanks

sony

Re: Need help to do inc load

avinashelite — Tue, 02 Apr 2019 13:32:52 GMT

I saw your data set, I have few queries
1.Everyday you will get years of years date value?
2.If yes, will their be any changes to the old records?
3.If you dont have update date column or lastest change columns try to base the incremental logic on primary key

Re: Need help to do inc load

Vegar — Tue, 02 Apr 2019 14:17:26 GMT

Incremental loads can be done in multiple ways depending on how data is updated and the needs of the business.

Here is a simple approach fetching all new rows based on the Day field.

I assume you have an inc_data.qvd with previous loaded data.

inc_data:
Load *
From inc_data.qvd (qvd);

TmpMaxDay:
LOAD Max(Day) as MaxDay;
LOAD FieldValue('Day', recno()) as Day
AUTOGENERATE FieldValueCount('Day');
Let vMaxDay = peek('MaxDay',-1,'TmpMaxDay')

Concatenate (inc_data)
Load * from DataSource
Where Day > $(vMaxDay);

Store inc_data into inc_data.qvd (qvd);

Re: Need help to do inc load

soniasweety — Tue, 02 Apr 2019 13:53:57 GMT

Hi @Vegar

im getting general error

attached is the error,

Re: Need help to do inc load

Vegar — Tue, 02 Apr 2019 14:20:20 GMT

It looks like I wrote the apostrophes with the wrong format. I've adjusted my earlier post with the right format.

Copy it again and retry

Re: Need help to do inc load

soniasweety — Tue, 02 Apr 2019 14:35:45 GMT

yeah its reloaded. thank you

let me check with my live data and come back