Skip to main content
Woohoo! Qlik Community has won “Best in Class Community” in the 2024 Khoros Kudos awards!
Announcements
Nov. 20th, Qlik Insider - Lakehouses: Driving the Future of Data & AI - PICK A SESSION
cancel
Showing results for 
Search instead for 
Did you mean: 
octopus8247
Contributor
Contributor

Incremental load by comparing qvd vs. db

Hi,

I have a table in postgres db which has to be incrementally loaded to qlik and stored to QVD. The problem is that table only has an ID field as primary key, and no timestamps. Records can be inserted into any place in the table, not only in the end;  i.e. simple approach "load where id > last cached id" won't work.

I don't see any other option than comparing data between DB and Qlik every time, and loading those IDs which are missing in Qlik table. I don't have issues with loading and storing data, but the comparison part is a bit tricky. How can it be implemented (Not Exists()? Join?).

Any advice is much appreciated. Thanks!

Labels (2)
1 Solution
2 Replies
vincent_ardiet_
Specialist
Specialist

The solution itself could also be less performant than reloading everything.
Are the ID a sequence or something similar which is always bigger than the previous value inserted?