topic Re: Data compare of 2 csv files in Talend Studio

Data compare of 2 csv files

LMgt1632137985 — Fri, 15 Nov 2024 23:43:03 GMT

Hi,

I need to compare the data of 2 csv files.

I already cleaned the data ( delete quotes, trim fields).

Files are differents, but have 90% of same columns and data, specially an ID column.

I want to check for each ID in the first file, if the data are the same in the second file for the same ID.

Need some tips or ideas to make this, I’m recent Talend user.

Thanks

Re: Data compare of 2 csv files

Anonymous — Fri, 24 Sep 2021 05:17:58 GMT

I think you need to do inner join between the two files and get the unmatched data, please take a look at this article.

Let me know if you still any troubles.

Regards

Shong

Re: Data compare of 2 csv files

LMgt1632137985 — Mon, 27 Sep 2021 07:43:54 GMT

Hi,

I made an inner join between the two files on my Id’s object and added equals expression on the field I want to compare. This is working very well thx.

The process is specific for each field cause I have to write expression for the output like

« row1.field.equals(row2.field) ? True : False »

Is this possible to make this process most generic as possible ? Or there will always need a necessary setting ?