Incremental Load (Reloading Last 31 Days Data )

[Satish]

Hello Qlik Experts,

Please guide me for creating Incremental load script based on my scenario.

Scenarion = I have Reload the data  based on max date and today () for last 30 days .

like 

my QVD has data of 5 Months Data(Jan,Feb,Mar,Apr,May)

so max date is 31/05/2019

and today is 21/06/2019 

Difference between is 20 Days ,

as incremetal load logic system will load the data from (24/05/2019) to today(21/06/2019).

so from(24/05/2019 to 31/05/2019 data should be override)

Thanx In Advance.

[felipedl · Accepted solution]

Hi,

Load your data first with the parameters you need (from (24/05/2019) to (21/06/2019)) the concatenate with the existing qvd data and use the not exists statement.

Give an unique identifier per date on your data (let's say something like ID+Date for the key)

Something like:

Inc_table:

Load * from [whatever] where date >= 24/05/2019 and date <= 21/06/2019

concatenate (Inc_table)

load * from [QVDs] where not exists [ID_Date];

That will load up only data from the QVD where there's no according ID_Date values, giving you an increment on the data you have on the QVDs.