Re: Incremental Load and appending files from a folder
My approach will be as below.
If QVD doesnt exists then 1. Load all the excels available in folder 2. Store that data in QVD using store statement. 3. Get the list of those files using file function. 4. Store those file names in QVD calles ETL. If QVD Exists 1. Load the file name from ETL QVD. 2. Get the list of files using file function from folder. 3. Compare both the data using Exist function and get the new file names. 4. Once we have the new file names, load the data of those files and concatenate same in Existing QVD. 5. Concatenate the Filename in ETL table.