Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
rustyfishbones
Master II
Master II

Incremental Load Issue WHERE EXISTS()

Hi All,

I have set up an incremental load

The initial extraction contains 270,000 rows, 17 days of data!.

I then take the max date from the extracted qvd and load today's data 11,340 rows

I then concatenate the two tables using WHERE NOT EXISTS(EventID)

The result I am expecting from the combined loads is 270,000 + about 20 rows as I can complete the process in under 1 minute

and the DB is generating about 20 rows per minute.

Instead of getting something like 270,020 I get 266,356.

In your experience could it be that the EventID is not unique???

Thanks

Alan

10 Replies
rustyfishbones
Master II
Master II
Author

Thanks I will try that

Sent from my iPhone