Best Practice regarding reading CSV file and duplicates

[JSey]

Hi

I was hoping I could get some suggestions for best practice.  A system generates multiple CSV for applications, each time with a different name based on time.  I understand I can use tFileList to read from multiple CSV.  I need to read these CSV's and insert them into Salesforce (new records, not update).  How can I ensure I am not creating duplicate records in Salesforce by not reading from the same CSV multiple times?

[TRF · Accepted solution]

Rename or move a file as soon as you have finish with it. This the simplest approach.

[JSey]

Thanks for the suggestion.  I looked it up, fFileCopy and remove source file should work.

https://community.talend.com/t5/Design-and-Development/Move-File-from-one-folder-to-another-folder/t...

[TRF]

That's it, the same component gives you the choice.