Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Help on incremental load

Dear All,

I would like to know if there are any solution for the issue that i'm facing.

I am creating a Qlikview report based on an ERP systems database and it takes longer time to load data into QVD. When checked some of the tables had fetched over 5 million of lines.

I have decided to use Incremental data load approach for those tables with large amount of data. When I checked the table it only have timestamp as its unique data field.

If this is the case how can i go about it.

thanks

3 Replies
Gysbert_Wassenaar

See this discussion for links about incremental load.


talk is cheap, supply exceeds demand
Not applicable
Author

Thank you for the links Gysbert. I have some what understood the concept of Incremental Load but my doubt now is how to implement it on a table with data as screenshot below.

DB_table.PNG

The examples I read explains that I need to have a primary key and a date field. I am not sure how to start with this timestamp data as I can't seem to convert them to normal dates.

rwunderlich
Partner Ambassador/MVP
Partner Ambassador/MVP

Hi Vivek,

It looks like your timestamp field is really the poorly named revision field of SQL Server 2005

http://msdn.microsoft.com/en-us/library/ms182776(v=sql.90).aspx

It is not really a timestamp field, but rather a binary number that gets incremented everytime a row gets updated. The datatype was renamed to "revision" in SQL Server 2008+.

So your timestamp column can serve as an update indicator.