Hi all,
How can I determine which records were rejected during an incremental load?
My sources are two QVDs. One is the HistoricalLoad.qvd and the other is the IncrementalLoad.qvd.
the Historical QVD has over 2 million records and my incremental load has 38,000 records.
For business reasons, we are not allowed to replace existing records during the incremental load. Therefore, we only perform an INSERT operation.
To accomplish this task, I'm using a hash128 based on the Customer Number, a date and the product id. The hash key is added to each record and stored as part of their respective QVD.
I have verified that the date in questions does not exist in the Historical QVD, but everytime I execute the incremental load, only 600 records get appended to the historical QVD.
Ideally, I would like to flag my rejects, perhaps by creating a third QVD names Incremental Load rejects, but for now I will be content with identifying the rejects between the two QVDs
Thanks for your assistance and support,
Robert
