Qlik Community

QlikView Scripting

Discussion Board for collaboration on QlikView Scripting.

Announcements

Breathe easy -- you now have more time to plan your next steps with Qlik!
QlikView 11.2 Extended Support is now valid through December 31, 2020. Click here for more information.

Not applicable

Incremental load

Hi,

Is it possible to do a incremental load from excel? Each month we have a new excel file with updates, wich means that the files will contain the same data. A distinct load will not work because the historic will sometimes change with one value. I want the qlik to only load the new records in the file/or changes.

Thanks

6 Replies
bbi_mba_76
Valued Contributor

Re: Incremental load

Hi,

you have to find a primary key in the loaded data and then use the exists function.

israrkhan
Valued Contributor II

Re: Incremental load

if you have date column in excel, the you can specify a where condition, and it should work.

but for updated records, you should have to update the date column as well with the record,

or could add separate column as Modified date. this column will have value only if the record has updated value else empty, so you can check in condition whether it is modified or not....

Not applicable

Re: Incremental load

Each month we will have a new column, for the below picture the next column "Month 7" will contain values for Month 7 since opening date. Dep, Club and openingdate will not change. I only want to load the "newest month".

sample.PNG.png

MVP
MVP

Re: Incremental load

If the prior month's data can also change (did I understand you correctly?), and you are loading from Excel, why would you want to load incrementally? Incremental load is most useful when loading large data sets, something like transactions data, there the model might contain say 20m rows, but you only want to load from the source, the 1,000 rows for the last day.

Jonathan

Logic will get you from a to b. Imagination will take you everywhere. - A Einstein
israrkhan
Valued Contributor II

Re: Incremental load

According to my knowledge , is does not seems possible.

but you could make search around.

davidrobles
New Contributor III

Re: Incremental load

Create a QVD with the first load.

After in the script

let vMonth= month(Today()); or number of month to load.

Load

     *

from yourQVD.qvd(QVD);

concatenate (if month is a field) or join (if the new month is a column)

load

     dep,

     club,

     opening_date,

     'Month ' & $(vMonth)               as Month

from YourExcel.