Is there a way to add or concatenate to the QVD's without having to load them in first? I am looking for the optimal way to do incremental loading and insert new transactional data daily without having to load it up first.
I agree with Jonas Heisterkamp. For incremental loads you will nearly always need a method to check if new data aren't already stored within the qvd (it's quite often that the workflow to fill the qvd isn't perfect ...). Also an optimized load from the qvd is extremly fast and shouldn't be a problem.
We are planning on creating one QVD for each month in a calendar year, and appending the transaction data to that specific month. I was curious to know if it was possible to append to the month QVD without loading the whole one.
As mentioned by Marcus_Sommer, we can do a load from the QVD on the last available transaction date and compare it to the new data to be added. The last available transaction should give us less resulting rows than the whole QVD worth of data, which we can then append to.