topic Help on incremental load in QlikView

Help on incremental load

Wed, 30 Jan 2013 09:07:18 GMT

Dear All,

I would like to know if there are any solution for the issue that i'm facing.

I am creating a Qlikview report based on an ERP systems database and it takes longer time to load data into QVD. When checked some of the tables had fetched over 5 million of lines.

I have decided to use Incremental data load approach for those tables with large amount of data. When I checked the table it only have timestamp as its unique data field.

If this is the case how can i go about it.

thanks

Re: Help on incremental load

Gysbert_Wassenaar — Wed, 30 Jan 2013 19:49:48 GMT

See this discussion for links about incremental load.

Re: Help on incremental load

Thu, 31 Jan 2013 02:44:55 GMT

Thank you for the links Gysbert. I have some what understood the concept of Incremental Load but my doubt now is how to implement it on a table with data as screenshot below.

The examples I read explains that I need to have a primary key and a date field. I am not sure how to start with this timestamp data as I can't seem to convert them to normal dates.

Re: Help on incremental load

rwunderlich — Thu, 31 Jan 2013 05:24:18 GMT

Hi Vivek,

It looks like your timestamp field is really the poorly named revision field of SQL Server 2005

http://msdn.microsoft.com/en-us/library/ms182776(v=sql.90).aspx

It is not really a timestamp field, but rather a binary number that gets incremented everytime a row gets updated. The datatype was renamed to "revision" in SQL Server 2008+.

So your timestamp column can serve as an update indicator.