We want to do an incremental load from a QVD file.
In a first step we store all data in a QVD file:
STORE Table INTO '$(QVDPath)' (qvd);
As far as we can tell this step works. For subsequent runs of the load script we want to retrieve all data that has been changed since the last run and concatenate it with the existing data from the QVD file:
Concatenate LOAD * FROM '$(QVDPath)' (qvd) WHERE NOT Exists(public_id);
We followed the examples in this file, particularly case 3 (Insert and Update (No Delete)): https://help.qlik.com/en-US/sense/1.1/Subsystems/Hub/Content/LoadData/UsingQVDFilesIncrementalLoad.htm
When the load script has finished we're missing 300,000 out of 8,300,000 records. Any idea what we could have overlooked?
[NB we're running Qlik Sense 2.2.4]