topic Re: Compare 3 datasets simultaneously and update other column on basis of comparison result. in Talend Studio

Compare 3 datasets simultaneously and update other column on basis of comparison result.

Anonymous — Sat, 16 Nov 2024 02:17:55 GMT

Hello Everyone,

Could you please help me with this below query.

I am using talend and postgres database. I have one table which has records with different types defined in column record_type(i.e- new, old and validated).

Now I need to compare these 3 type at once and update other column with different value.

example - If new,old and validated are same then "A"

If new,old are same and validate is different then "B"

If old and validated are same and new is different then "C" and so on.

Could you please provide some efficient way.

Thanks,

Shubhi Srivastava

Re: Compare 3 datasets simultaneously and update other column on basis of comparison result.

manodwhb — Thu, 28 May 2020 14:21:51 GMT

@shubhi04 , can you give some sample input and output data?

Re: Compare 3 datasets simultaneously and update other column on basis of comparison result.

akumar2301 — Thu, 28 May 2020 21:24:44 GMT

There must be record key if you have record type.

Now with you can do many things

1) sort input with key column
2) pivot the table on key column
https://help.talend.com/reader/jomWd_GKqAmTZviwG_oxHQ/x2GUXKMQs_wrCX0kdZDwDg
Or

Memories three records value using tmemorizerows

3) then compare results accordingly.

Abhishek

Re: Compare 3 datasets simultaneously and update other column on basis of comparison result.

Anonymous — Fri, 29 May 2020 11:22:04 GMT

@uganesh ,

my overall requirement is different. I don't want to pivot data. As the data is being aggregated in later steps. and then aggregated data again get de-aggregate. Also, in my table there are more then 100 columns.

Also, the data size is huge and coming in daily batches so need to maintain performance too.

@manodwhb

Attaching one sample excel with this. Just not putting exact columns and data.

Sample_test.xlsx