Thanks for replay but can u explain more clearly,i know how to append the data using incremental load but i dont know how to upload modified data into qvd.
I was looking for a solution to a similar question I was looking for help on and I how hoping that someone could clearify something for me.
I can see how both the example from rav 1234 and from Sunil Jain would append new records to the new qvd but I am not understanding how these methods would update a record.
If a record in the original source table has a record that all ready exists in your qvd and the record is updated then wouldnt just the lastmodified date field value be the only difference? So why the primary key to update, that didnt change so it would not add the record. My thinking was that you would use a combination of the two fields. Checking for new primary key thus adding new records to your new qvd and then checking existing primarykey fields in both sources to then check if the last modified date field changed?
To utilize Incremental Load a source table must have both of the following attributes:
A unique identifier -- a Primary Key -- for each row.
A "Modification" column that identifies when a row was added or updated. The column type may be a Date, Datetime or ascending Revision number.
The classic IL logic is this:
Determine the "Last reload Time". The most robust technique is to extract the max value for the "Modification" column from the Master QVD.
Select rows from the database table where "Modification" is greater than "Last Reload Time".
Add and update rows in the Master QVD, based on primary key.
BUT My situation is as follows :
My scenario is a bit different. I have multiple excel sheets being stored in a folder ( these are periodic extractions from the same source system, so same fields everytime ), no primary key available ( not at least without building a composite key using several fields...which affects performance seriously..and I disregarded ); also there is not any datestamp column on these files, and the way I manually create a datestamp column is by using part of the file names in the Qview script. So every file stored I name it like : yyyymmdd-abc.xls ( being yyyymmdd the date when I get the extract and store it in the folder ).Then using a "for each a in" ..function I load these files in sequence adding a datestamp field like $(a) as DateStamp. Then all is stored in a QVD file. What I need to accomplish is everytime I do a data reload I need to avoid loading all the xls files again ( and building the whole QVD again )wasting time. I would need the script to only load the newer xls files stored in the folder. Any ideas on how to set it up ?
