10 Replies Latest reply: Oct 17, 2014 1:19 PM by Alan Farrell RSS

    Incremental Load Issue WHERE EXISTS()

    Alan Farrell

      Hi All,

       

      I have set up an incremental load

       

      The initial extraction contains 270,000 rows, 17 days of data!.

       

      I then take the max date from the extracted qvd and load today's data 11,340 rows

       

      I then concatenate the two tables using WHERE NOT EXISTS(EventID)

       

      The result I am expecting from the combined loads is 270,000 + about 20 rows as I can complete the process in under 1 minute

      and the DB is generating about 20 rows per minute.

       

      Instead of getting something like 270,020 I get 266,356.

       

      In your experience could it be that the EventID is not unique???

       

      Thanks

       

      Alan