topic Re: incremental load to qvd in QlikView

incremental load to qvd

Thu, 20 Mar 2014 18:47:53 GMT

Hi Folks,

Please consider the below scenario:

I have few productIDs and ProductName in csv file which is a Source. I load them to product.qvd for the first time. There are few more reocrds added to source file. Next time I am running the script only new additions should be loaded(appended) to the product.qvd. How do I script this process to have this cyclic incremental load?

Please help out.

Thank you.

Re: incremental load to qvd

pgrenier — Thu, 20 Mar 2014 18:52:36 GMT

Hello Pramod,

Basically you could accomplish this with these steps (once your QVD has been initially created)

1) Load contents from your QVD file in a table

2) Concatenate into your table the new products with the not Exists() fonction

3) Store your table under the original QVD name

I would also invite you to look at the QlikView suggested approach in the F1 help by searching for the "Using QVD Files for Incremental Load". You shall find nice tricks of how to append, refresh, elimitate old data, etc, from your QVD files.

Regards,

Philippe

Re: incremental load to qvd

Colin-Albert — Thu, 20 Mar 2014 18:53:34 GMT

see this thread

Incremental reload and store into QVD file

Re: incremental load to qvd

shree909 — Thu, 20 Mar 2014 18:54:31 GMT

Hi Pramod,

Incremental loading works only when u have unique records.

First u need to find out the unique records, next time when u load u have load only the new records that are greater than the (Product IDS).

First u need to find out the maximum Product id using resident load.

Second store the Max prod ID into a variable,

Temp:

Load Product ID from QvdFile;

Noconcatenate

Temp1:

Load MAX(ProdcutID) as MAXProdId

resident Temp;

Let VmaxProdID =peek('Temp1',0,MAXProdId);

Drop Table Temp;

ProductsTable:

load * from

where product ID >'$(VmaxProdID)';

concatenate(ProdcutsTable)

load * from qvd file ;

Thanks