Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
mrao1686214107
Contributor
Contributor

incremental load

How to implement incremental loading in Talend

Labels (3)
2 Replies
anselmopeixoto
Partner - Creator III
Partner - Creator III

Hi @mane rao​ 

 

There are many options to achieve incremental loading. To state two:

 

  1. You could use CDC feature, though its a subscription only feature
  2. You could use some attribute of your target output, like an ID or Timestamp column to retrieve the last processed record on previous Job execution and then use a filter on the input based on this same attribute
Anonymous
Not applicable

Hello,

As there are so many topics about incremental load in community, just search them with the key word 'incremental load', you will get some solution and answers.

https://community.talend.com/s/question/0D53p00007vCkMrCAK/how-to-do-incremental-loading-in-talend

https://community.talend.com/s/question/0D53p00007vCnyuCAC/incremental-load

Best regards

Sabrina