10 Replies Latest reply: Oct 17, 2014 1:19 PM by Alan Farrell RSS

    Incremental Load Issue WHERE EXISTS()

    Alan Farrell

      Hi All,


      I have set up an incremental load


      The initial extraction contains 270,000 rows, 17 days of data!.


      I then take the max date from the extracted qvd and load today's data 11,340 rows


      I then concatenate the two tables using WHERE NOT EXISTS(EventID)


      The result I am expecting from the combined loads is 270,000 + about 20 rows as I can complete the process in under 1 minute

      and the DB is generating about 20 rows per minute.


      Instead of getting something like 270,020 I get 266,356.


      In your experience could it be that the EventID is not unique???