Qlik Community

Ask a Question

QlikView App Dev

Discussion Board for collaboration related to QlikView App Development.

Announcements
Our next Qlik Insider session will cover new key capabilities. Join us August 11th REGISTER TODAY
cancel
Showing results for 
Search instead for 
Did you mean: 
nihhalmca
Specialist II
Specialist II

Incremental Load without Date field

Hi All,

How can implement incremental load without date field. My data source is Excel file and Database.

Those has tables without date filed.

Thanks,

Regards,

Nihhal.

1 Solution

Accepted Solutions
MK_QSL
MVP
MVP

For insert only Incremental Load, you need to have at least one of below

  1. 1) Last updated date or any date field
  2. 2) Sequential ID

Using above you can identify new records while extracting from the databased.

I also read a blog post from Barry Harmsen about creating a Hash Key from combinng the non-key fields, but never tried it. While extracting the new records, you need to check each key value and load only those values where the Hash Key if different.  I suspect about performance issue on this. I would like to try it once at least. You can have a look!

http://www.qlikfix.com/2014/03/11/hash-functions-collisions/

You can use AutoNumberHash128(),AutoNumberHash256().

Hope this helps !

View solution in original post

22 Replies
sushil353
Master II
Master II

You can also check for primary key in your table to get increment data

Not applicable

create primary key and do increment laod on primary key

nihhalmca
Specialist II
Specialist II
Author

Hi,

Sushi thanks for response.

I am trying to do 'insert only' i think primary key is not mandatory

Regards,

Nihhal..

nihhalmca
Specialist II
Specialist II
Author

Hi Ranga,

Thanks for response.

There is any other approach.instead of primary key.

Regards,

Nihhal.

jonathandienst

You don't specify what type of incremental load you need.

The simplest is add-only incremental load. This requires some way of identifying new records - it does not have to be a date-added or date-modified field. If you have a increasing key value, you can identify new records using the key as well.This may be a primary key in the database table, but any continually increasing field value will work.

If you cannot identify newly added records, then add-only incremental load is not possible.

Logic will get you from a to b. Imagination will take you everywhere. - A Einstein
nihhalmca
Specialist II
Specialist II
Author

Hi Jonathan,

Thanks for response.

My question is simple it is possible incremental load without date field and primary key?.

Regards,

Nihhal.

MK_QSL
MVP
MVP

For insert only Incremental Load, you need to have at least one of below

  1. 1) Last updated date or any date field
  2. 2) Sequential ID

Using above you can identify new records while extracting from the databased.

I also read a blog post from Barry Harmsen about creating a Hash Key from combinng the non-key fields, but never tried it. While extracting the new records, you need to check each key value and load only those values where the Hash Key if different.  I suspect about performance issue on this. I would like to try it once at least. You can have a look!

http://www.qlikfix.com/2014/03/11/hash-functions-collisions/

You can use AutoNumberHash128(),AutoNumberHash256().

Hope this helps !

View solution in original post

jagan
Luminary Alumni
Luminary Alumni

Hi Nihhal,

It is not possible to implement incremental loading without key (May not be primary key) and Date field.  There should be some logic to find the records unique.  The records may be unique by using multiple fields.  If you attach some sample data then it would be easier to analyse and provide the solution.

Regards,

jagan.

qlikviewwizard
Master II
Master II

Hi nihhalmca

Can you attach some sample data for provide the sample data?