Qlik Community

New to Qlik Sense

Discussion board where members can get started with Qlik Sense.

Announcements
QlikWorld 2020: Join us May 11 - 14, 2020 in Phoenix, AZ. Register early and save $400. Learn More
Partner
Partner

Incremental Load (Reloading Last 31 Days Data )

Hello Qlik Experts,

Please guide me for creating Incremental load script based on my scenario.

Scenarion = I have Reload the data  based on max date and today () for last 30 days .

like 

my QVD has data of 5 Months Data(Jan,Feb,Mar,Apr,May)

so max date is 31/05/2019

and today is 21/06/2019 

Difference between is 20 Days ,

as incremetal load logic system will load the data from (24/05/2019) to today(21/06/2019).

so from(24/05/2019 to 31/05/2019 data should be override)

 

Thanx In Advance.

1 Solution

Accepted Solutions
Partner
Partner

Re: Incremental Load (Reloading Last 31 Days Data )

Hi,

 

Load your data first with the parameters you need (from (24/05/2019) to (21/06/2019)) the concatenate with the existing qvd data and use the not exists statement.

Give an unique identifier per date on your data (let's say something like ID+Date for the key)

Something like:

 

Inc_table:

Load * from [whatever] where date >= 24/05/2019 and date <= 21/06/2019

 

concatenate (Inc_table)

load * from [QVDs] where not exists [ID_Date];

 

That will load up only data from the QVD where there's no according ID_Date values, giving you an increment on the data you have on the QVDs.

View solution in original post

1 Reply
Partner
Partner

Re: Incremental Load (Reloading Last 31 Days Data )

Hi,

 

Load your data first with the parameters you need (from (24/05/2019) to (21/06/2019)) the concatenate with the existing qvd data and use the not exists statement.

Give an unique identifier per date on your data (let's say something like ID+Date for the key)

Something like:

 

Inc_table:

Load * from [whatever] where date >= 24/05/2019 and date <= 21/06/2019

 

concatenate (Inc_table)

load * from [QVDs] where not exists [ID_Date];

 

That will load up only data from the QVD where there's no according ID_Date values, giving you an increment on the data you have on the QVDs.

View solution in original post