15 Replies Latest reply: Jul 10, 2017 12:32 AM by Ravi Balar RSS

    Incremental Load with multiple CSV files and single sheet

    varaha sasi vardhan kandragula



      Have one requirement:


      1. Load multiple CSV files appended with date e.g: 2017-03-28 EMP Data.csv [Done]

      2. based on file name date column need to be extracted[Done]

      2. All csv files will be one single folder[Done]

      3. Load all csv files and concatenate to one single table[Done]

      4. After loading the files, old csv files will be deleted [Pending]

      4. daily new file will be placed and append new file records to existing records in QV table[Pending]


      PFA sample csv files and qvw


      Can any one please let me know the incremental load logic need to be applied here.