Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in Bucharest on Sept 18th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Help on incremental load

Dear All,

I would like to know if there are any solution for the issue that i'm facing.

I am creating a Qlikview report based on an ERP systems database and it takes longer time to load data into QVD. When checked some of the tables had fetched over 5 million of lines.

I have decided to use Incremental data load approach for those tables with large amount of data. When I checked the table it only have timestamp as its unique data field.

If this is the case how can i go about it.

thanks

3 Replies
Gysbert_Wassenaar
Partner - Champion III
Partner - Champion III

See this discussion for links about incremental load.


talk is cheap, supply exceeds demand
Not applicable
Author

Thank you for the links Gysbert. I have some what understood the concept of Incremental Load but my doubt now is how to implement it on a table with data as screenshot below.

DB_table.PNG

The examples I read explains that I need to have a primary key and a date field. I am not sure how to start with this timestamp data as I can't seem to convert them to normal dates.

rwunderlich
Partner Ambassador/MVP
Partner Ambassador/MVP

Hi Vivek,

It looks like your timestamp field is really the poorly named revision field of SQL Server 2005

http://msdn.microsoft.com/en-us/library/ms182776(v=sql.90).aspx

It is not really a timestamp field, but rather a binary number that gets incremented everytime a row gets updated. The datatype was renamed to "revision" in SQL Server 2008+.

So your timestamp column can serve as an update indicator.