topic Re: Compare CSV file versus DB Records in Talend Studio

Compare CSV file versus DB Records

_AnonymousUser — Sat, 16 Nov 2024 12:24:35 GMT

Hi there,
New Talend user here. First day of using Talend Integration Suite 4.1.1. I am trying to compare and validate a CSV file versus records in MSSQL DB Table. Do you have any idea how to do this in a nice way? Or i would very much appreciate if you can provide me sample screenshot on the components involve.
Best Regards,
Andres

Re: Compare CSV file versus DB Records

Anonymous — Thu, 02 Feb 2012 15:51:33 GMT

Hi,
You can use the components tFileInputDelimited for the csv file and tMSSqlInput for the DB table and then use tMap. Make sure to inner join the map and map all fields that you want to compare.
Then create 2 output components. The first output could contain the matched records and the second output could contain the non-matched records. You can catch these non-matched records with the "catch inner join rejects" option in the output.
Good luck

Re: Compare CSV file versus DB Records

_AnonymousUser — Fri, 03 Feb 2012 03:09:06 GMT

Good Job! many thanks

Re: Compare CSV file versus DB Records

_AnonymousUser — Wed, 08 Feb 2012 07:01:34 GMT

Thanks. I was able to do this.
My next problem is, If there is no data in that Table I want this CSV file to populate that table.
how to do this using this scenario:
CSV(tFileInputDelimited) ----> tMAP <---- Table (tMSSLQInlput)

Re: Compare CSV file versus DB Records

Anonymous — Wed, 08 Feb 2012 08:04:42 GMT

Hi,
As saukema said, create a new ouput which will catch the reject. Put your csv as a source and your table as a lookup.

Re: Compare CSV file versus DB Records

_AnonymousUser — Wed, 08 Feb 2012 08:33:11 GMT

I already did that. This solution only compares. It does not insert to DB.
see here:
CSV(tFileInputDelimited) ----> tMAP <---- Table (tMSSLQInlput)
| |
| |
tFileOutputDelimited1 tFileOutputDelimited2
wit this scenario, how can i insert the result to TABLE.

Re: Compare CSV file versus DB Records

Anonymous — Wed, 08 Feb 2012 08:58:34 GMT

Link your output reject to a tMSSQLOutput.

Re: Compare CSV file versus DB Records

_AnonymousUser — Thu, 09 Feb 2012 02:30:30 GMT

Thanks. it is now working.