topic Incremental Load ( I think ) in QlikView

Incremental Load ( I think )

Thu, 19 Jan 2012 09:29:59 GMT

This is my 2012 challenge; At present each night I pull down from our Oracle Database each table into a QVD file and then refresh each app.

One particurlar table PLY_POLICY has 4 million rows and can take upto 30 minutes to load.

My tentative reading suggests I should be able to do an Incremental Load for Changes and New Additions only.

Potentially most fields could change on each row so I need to avoid duplicate records.

I did look around this community, found some dead links and then seeing as I have never done this before figured time to ask before I go horribly wrong and get frustrated.

Many thanks,

Rob

Incremental Load ( I think )

fosuzuki — Mon, 23 Jan 2012 21:22:22 GMT

Hi Rob,

You can find some info in the QlikView Reference Manual. In the V10 1st edition, as of Oct/10, it has the section '25.7 Using QVD files for incremental load' in the Book I. It even has some sample code.

I'd guess that it has enough info for you to not get frustrated...

Regards,

Fernando

Incremental Load ( I think )

rwunderlich — Mon, 23 Jan 2012 21:57:23 GMT

The Ref guide is a good overview. Additional resources I suggest:

1. Qlikview Cookbook http://robwunderlich.com/downloads provides an working incremental load example.

2. Qlikview Components http://qlikviewcomponents.org will let you do the whole thing with a couple lines of code.http://qlikviewnotes.blogspot.com/2012/01/incremental-load-using-qlikview.html

-Rob