topic load table with only new data in QlikView

load table with only new data

amien — Wed, 31 Mar 2010 08:53:03 GMT

i have a table loaded in qv that contains data from a csv file.

Now i want to load that same csv file again. Only the new records that are found should be added to the qv-table.

the ones not found should not be deleted.

i have other tables/sources in the same qv that needs a full refresh. So the above mentioned table has a different load methode compaired to the rest.

is this possible?

load table with only new data

blaise — Wed, 31 Mar 2010 09:09:52 GMT

If you have a distinct number/string (like an invoice no) in the csv file you can use the "where not exists()". This will only loads records not previously loaded.

First LOAD:

LOAD * from csv ...;

Second LOAD:

LOAD * from qvd ...;

concatenate LOAD * from csv ... where not exists(InvoiceNo);

load table with only new data

Wed, 31 Mar 2010 09:17:24 GMT

Hi Amien,

first of all are a date field or a flag field in your excel file which can be used to identify new records?

If YES do an initial load and save your table as a *.qvd file.

Find MaxDate as example and expand the load statement .....from ..... Where Date > $(MaxDate);

Now load your *.qvd file. QlikView concatenate the new records to the ones coming from your qvd.

Store the new *.qvd file. Get the new MaxDate and so on.

See also the attached application (comments are in german but i´m sure you will understand the logic).

Good luck!

Rainer

load table with only new data

amien — Wed, 31 Mar 2010 22:09:28 GMT

Thank you .. very clear!