topic Re: How to implement Incremental load in QlikView

How to implement Incremental load

Thu, 29 Nov 2012 08:50:26 GMT

Hi,

How to implement Incremental load? I want daily incremental laod because one of the report on PROD uses CPU 100% for 30-40 mins daily.

BR,

Anta

Re: How to implement Incremental load

Anonymous — Thu, 29 Nov 2012 09:29:09 GMT

The logic I am following for an incremental load is as follows :

1 - Select all the records that's created today from database (There should be a similar field to transaction_date to restrict).

2 - Load all transaction except today's from the QVD file

3 - Store the merged data from (1) and (2) to the QVD (This is will update the QVD with todays records).

Using this logic is helpful esp. if the records are to be refreshed many times, it will only keep the recent records loaded.

I have a question for you Anta, what if the last week's recrods get's updated? If it was a financial or business system then I assume only current year's data will be updated or changed. So I am updating all QVD on yearly basis. E.g I dont update 2011 QVD as all the accounting periods are closed and its not likely that any of the records will be changed.

I hope this helps!

Regards

MultiView

Re: How to implement Incremental load

jagan — Thu, 29 Nov 2012 09:47:14 GMT

Hi,

Please check Qlikview Help file it has detailed explanation about Incremental load using QVD. Check the top

"Using QVD Files for Incremental Load" in Qlikview help file.

Hope this helps you.

Regards,

Jagan.

Re: How to implement Incremental load

Thu, 29 Nov 2012 11:42:54 GMT

Yes, I want to update just daily data.. From help, I dont understand which type shoudl I used? i.e.

Append only (Logfiles).

2) Insert only (No Update or Delete).

3) Insert and Update (No Delete).

4) Insert, Update and Delete.

BR,

Anta

Re: How to implement Incremental load

jagan — Thu, 29 Nov 2012 12:07:15 GMT

Hi,

Load type is based on your table

1) If your database is a log file then you should use Append only method.

2) If your table allows Only Insertion of records and no update/delete then Insert only is used.

3) If your table allows Insertion and update of records and no delete then Insert and Update is used.

4) If your table allows Insertion, update and deletion of records then Insert, Update and Delete is used.

Hope this helps you.

Regards,

Jagan.