Incremental load

[#1]

Hi,

Is it possible to do a incremental load from excel? Each month we have a new excel file with updates, wich means that the files will contain the same data. A distinct load will not work because the historic will sometimes change with one value. I want the qlik to only load the new records in the file/or changes.

Thanks

[bbi_mba_76]

Hi,

you have to find a primary key in the loaded data and then use the exists function.

[israrkhan]

if you have date column in excel, the you can specify a where condition, and it should work.

but for updated records, you should have to update the date column as well with the record,

or could add separate column as Modified date. this column will have value only if the record has updated value else empty, so you can check in condition whether it is modified or not....

[#4]

Each month we will have a new column, for the below picture the next column "Month 7" will contain values for Month 7 since opening date. Dep, Club and openingdate will not change. I only want to load the "newest month".

[jonathandienst]

If the prior month's data can also change (did I understand you correctly?), and you are loading from Excel, why would you want to load incrementally? Incremental load is most useful when loading large data sets, something like transactions data, there the model might contain say 20m rows, but you only want to load from the source, the 1,000 rows for the last day.

Jonathan

[israrkhan]

According to my knowledge , is does not seems possible.

but you could make search around.

[davidrobles]

Create a QVD with the first load.

After in the script

let vMonth= month(Today()); or number of month to load.

Load

     *

from yourQVD.qvd(QVD);

concatenate (if month is a field) or join (if the new month is a column)

load

     dep,

     club,

     opening_date,

     'Month ' & $(vMonth)               as Month

from YourExcel.