incremental load

[manoj217]

i want to reload the application twice in a day but i have taken date stamp like max(date) for the peek function . based on these it will reload one in a day how can i achieve this

[shiveshsingh]

Try this

maxdate:load max(date) as Max_Date;

let vMAX = peek('Max_Date',0,'maxdate');

load fieldnames

from source where date> '$(vMAX)';

concatenate

load fieldnames

from old_qvd;

store data into onld_qvd;

[kaushiknsolanki]

Hi  Try this logic

Get all the data for the same day and while concatenating with QVD remove the same day data and then store it in QVD;

Regards,

Kaushik Solanki

[manoj217]

yes, but it will reload all the data on that day.

but my requirement is i am reloading at 12AM it has added 1 lakh records and same day at 12PM reloading the application in same day now hv to load only newly changed data  after the 1 lakh records

[kaushiknsolanki]

Hi,

Then you should have a timestamp in database which will tell you that this are the new records which got updated after 1pm.

Do you have it?

Regards,

Kaushik Solanki

[manoj217]

if we have the time stamp then also how to implement the two incremental loads for that we need if conditions, end if, if then do logic's  are needed

[kaushiknsolanki]

Hi,

If you have timestamp then normal incremental load script will work, you dont need to do anything extra.

It will get you new data every time you reload.

Regards,

Kaushik Solanki