Qlik Community

Ask a Question

App Development

Discussion board where members can learn more about Qlik Sense App Development and Usage.

Announcements
Join us for a live Q&A! September 21, 10 AM ET - Onboarding Fast in Qlik Sense SaaS! REGISTER
cancel
Showing results for 
Search instead for 
Did you mean: 
rsdhavle
Creator II
Creator II

Query_Incremental Load_Insert and Update

We have loaded data for 365 days in QVD. And have around 3L rows. 

Now we have written incremental load as follows as we want to check last 60 days data and concatenate with existing QVD which has 1 year data

Load

ID,

Details,

Date

From QVD where Date > (vDate..last 60 days)

Concatenate

Load * from Existing.qvd where not exist (ID)

 

when we are doing this rows are getting reduced to around 75K. I am assuming its taking only last 60 days data. Ideally it should take for complete year and should check for 60 days for update.

Are we missing on anything?

 

Labels (2)
4 Replies
arpitkharkia
Creator III
Creator III

By reading it i feel your ID may not be unique enough to use it as a condition. You may want to use a combination of your ID and Date as the unique ID.

Please try and let me know.

rsdhavle
Creator II
Creator II
Author

Hi..yes we have ID as combination of Date and ID already..

arpitkharkia
Creator III
Creator III

try combining the 'Details' field also

arpitkharkia
Creator III
Creator III

or you can change your base table

Load * from Existing.qvd

concatenate

Load

ID,

Details,

Date

From QVD where Date > (vDate..last 60 days)