topic Re: incremental load in QlikView

incremental load

manoj217 — Wed, 25 Nov 2020 16:16:04 GMT

i want to reload the application twice in a day but i have taken date stamp like max(date) for the peek function . based on these it will reload one in a day how can i achieve this

Re: incremental load

shiveshsingh — Fri, 16 Feb 2018 10:04:58 GMT

Try this

maxdate:load max(date) as Max_Date;

let vMAX = peek('Max_Date',0,'maxdate');

load fieldnames

from source where date> '$(vMAX)';

concatenate

load fieldnames

from old_qvd;

store data into onld_qvd;

Re: incremental load

kaushiknsolanki — Fri, 16 Feb 2018 10:36:24 GMT

Hi Try this logic

Get all the data for the same day and while concatenating with QVD remove the same day data and then store it in QVD;

Regards,

Kaushik Solanki

Re: incremental load

manoj217 — Mon, 19 Feb 2018 07:20:25 GMT

yes, but it will reload all the data on that day.

but my requirement is i am reloading at 12AM it has added 1 lakh records and same day at 12PM reloading the application in same day now hv to load only newly changed data after the 1 lakh records

Re: incremental load

kaushiknsolanki — Mon, 19 Feb 2018 07:34:47 GMT

Hi,

Then you should have a timestamp in database which will tell you that this are the new records which got updated after 1pm.

Do you have it?

Regards,

Kaushik Solanki

Re: incremental load

manoj217 — Mon, 19 Feb 2018 07:39:42 GMT

if we have the time stamp then also how to implement the two incremental loads for that we need if conditions, end if, if then do logic's are needed

Re: incremental load

kaushiknsolanki — Mon, 19 Feb 2018 07:43:58 GMT

Hi,

If you have timestamp then normal incremental load script will work, you dont need to do anything extra.

It will get you new data every time you reload.

Regards,

Kaushik Solanki