How to check if a record Exists in DB

[Anonymous]

I have a folder of excel files
Talend package reads the folder and for each excel file in the folder it unpivots the content of the excel file and inserts in a MSSQL database.
Now the same row/record could exist in multiple files and thats why we keep getting duplicates in the database.
if someone could help me understand, if there is a way to check if the record exists in MSSQL DB, before inserting then i can skip duplicates and just get unique records. Please see the attached screenshot.
Thanks

[Anonymous]

You can dump the data from all the excel files in 1 table. Post that you can only move unique or latest records in your actual table.

[mmctony]

Hi,

I have to perform "insert if not exist" into tables that don't have any primary key. I cannot edit database tables' definition in order to add primary keys.

If I manually set primary key fields in the schema retrieved by Talend, will Talend be able to avoid creating duplicates of existing rows then?

Thanks for your help,

Mick

[Anonymous]

Hello,

We can add a combobox called ACTION on the tDBOutput component.

ACTION properties will be "INSERT", "UPDATE", "INSERT OR UPDATE" or "UPDATE OR INSERT".

"INSERT OR UPDATE" means if the insertion failed, update operation will be perform.

Best regards

Sabrina