Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Append Load, Only load new data

Hi,

I am loading data from a call center and running reports off of it, each new call is logged into a table within an SQL database with a Call ID. At the moment every time the data is reloaded all the data is pulled from the table. I have started to create a append load to only reload "new" data.

How do I specifie to only load new data after the latest time and date previously loaded in the last load?

Here is my current code:


Inbound:
LOAD *
SQL SELECT
FROM Database.Inbound;
CONCATENATE
LOAD * FROM
(qvd);
STORE Inbound into E://Inbound.qvd;
[\code]
I want to say only load new data stored in the Inbound table in the database which hasnt already been loaded? so take the latest time/date loaded in the last load and load new data written to the database after that?
Hope that makes sence.
Cheers, Joe</body>
1 Reply
prieper
Master II
Master II

Have no code on hand, would suggest

  1. load qvd
  2. determine max Date and relay into a variable
  3. load your data with ...WHERE Date > MyVariable

HTH
Peter