6 Replies Latest reply: Mar 20, 2014 9:02 AM by Thomas Jensen RSS

    incremental load different customers on different dates

      Hello,

       

      I have one giant view which contains data for 20 customers. All these customers has a CustomerKey and a datefield and more.

       

      Due to millions of rows i wanna do an incremental load. But the thing is, if one customer fails the date might be earlier than the other customers dates. therefore i need to incremental load my view for each customers latest date. How can i do so?

       

      Im guessing i should make some kinda loop, but how i should write i dont know? Can somebody help?

       

      Latest Load Date Table

      LatestRunLogKeyLatestDateLoadFrom
      12014-03-14 12:00:00.000

      Example of the table:

       

      CustomerKeyDatefieldSalesProductName
      12014-03-14 12:00:00.00010Cheese
      12014-03-14 13:00:00.00010Cheese
      12014-03-14 14:00:00.00010Cheese
      22014-03-14 12:30:00.00010Cheese
      22014-03-14 14:37:00.00010Cheese
      22014-03-14 12:53:00.00010Cheese
      32014-03-10 12:00:00.00010Cheese
      32014-03-10 12:00:00.00010Cheese

       

      So as you can see CustomerKey 3 data will not be loaded cause the latest last time load date was 2014-03-14 12:00:00.000 - and because customerkey 3 failede last time they did not have any data in the view. Now they do but its older than the latestdateloadfrom date.