Skip to main content
Announcements
Introducing a new Enhanced File Management feature in Qlik Cloud! GET THE DETAILS!
cancel
Showing results for 
Search instead for 
Did you mean: 
Ven6
Contributor III
Contributor III

Copy a new entry

Hello

I need your help
I have a table A (Name, first name, age, sex) which is my source.
I would like that with each passage of the job it copies only the new information recorded and not the whole table.

 

pls help

Labels (2)
1 Solution

Accepted Solutions
fdenis
Master
Master

it depend on your case and your db.
can you change data structure?
if yes add unique Id column and a Boolean one named read default as false.
then in talend read all line where read=false.
when work is done, update source table with read =true where id = current id.

View solution in original post

3 Replies
fdenis
Master
Master

you may read CDC change data capture components docs.
you can use and store the list of already read Ids.
you can use and store the last inserted sequence number or date.
you can insert trigger into source to fill a queue or a table.
there is a lot of ways depending on your case….
Ven6
Contributor III
Contributor III
Author

Please an explicite example
fdenis
Master
Master

it depend on your case and your db.
can you change data structure?
if yes add unique Id column and a Boolean one named read default as false.
then in talend read all line where read=false.
when work is done, update source table with read =true where id = current id.