Incremental loading

[sudhirreddy]

Hello experts,

I am working on Incremental loading. Here is my problem.

Imagine I have 7 days worth of data (Day1, Day2,..,Day7). I have loaded these 7 days of data into a qvd file.

Tomorrow I will get (Day8) data and (Day 9) the next day and so on.

Once Day8 data is available my model should delete Day1 and Insert Day8 data into the qvd.

If Day9 is available it should delete Day2 and Insert Day9 data into the qvd.

If Day10 is available it should delete Day3 and Insert Day10 data into the qvd. And so on.

Please help me. Thanks in advance.

[edwin]

it would be better if you can create a computed dimension that has day number (1..7)  this will of course depend on a starting date which will be day 1.

load the increment first, then just do a NOT EXIST on the computed date field that will load only the ones that arent in the incremental. 

if you cant create the computed DAY field in your incremental file, thats fine you can compute it at the time you load your incremental file and then save that new field in the final QVD.  when loading the final QVD just do a where not exist (DAYField, <expression here>)

where DAYField is the computed DAY field.