topic Re: Copy a new entry in Talend Studio

Copy a new entry

Ven6 — Tue, 07 Jan 2020 09:10:14 GMT

Hello

I need your help
I have a table A (Name, first name, age, sex) which is my source.
I would like that with each passage of the job it copies only the new information recorded and not the whole table.

pls help

Re: Copy a new entry

fdenis — Tue, 07 Jan 2020 09:21:27 GMT

you may read CDC change data capture components docs.
you can use and store the list of already read Ids.
you can use and store the last inserted sequence number or date.
you can insert trigger into source to fill a queue or a table.
there is a lot of ways depending on your case….

Re: Copy a new entry

Ven6 — Tue, 07 Jan 2020 09:39:22 GMT

Please an explicite example

Re: Copy a new entry

fdenis — Tue, 07 Jan 2020 10:29:00 GMT

it depend on your case and your db.
can you change data structure?
if yes add unique Id column and a Boolean one named read default as false.
then in talend read all line where read=false.
when work is done, update source table with read =true where id = current id.