talend import data into a database without duplicating data

[oguedda]

Hello everybody,

i have a job which imports data from an API REST into a database SQL Server and this job is scheduled to be executed every month, the problem is that even if the data already exists on the database it injects it as same.

I would like to inject that data which does not exist in the database.

Any help please,

thank you in advance.

[Anonymous]

Hello,

Would you mind posting your job design screenshots here? Are you trying to capturing changed data via tMap component in your work flow?

If you want to capture the changed data and only load these changed data into target table to achieve table sync, you can compare tables by using tMap.

The work flow should be:

Target DB-->tMap(inner join for input and set the "Catch lookup inner join" as true)-->output

 Source DB-->

The output will be the changed data.

Best regards

Sabrina

[oguedda · Accepted solution]

Hello @Xiaodi Shi​ ,

Thank you for your answer,

I found the solution by adding the primary key in my table and on the database parameters you have to choose "insert if not exist" instead of "insert" as indicated in the screenshoot

 

Hoping that help someone

[Anonymous]

Hello,

Great it is resolved by yourself. Thanks for letting us know your solution.

Best regards

Sabrina