topic Re: comparing data in 2 columns in Talend Studio

comparing data in 2 columns

lmit — Tue, 12 Mar 2019 10:19:26 GMT

Hi All,

I have 2 files (one is history file and the other is current file)

the history file has a column called Commidty_Code and data in this is like "1|2|3"

the current file also has the same data in commidty_code but the current file can have new values add or removed like "1|2|3|4" or "2|3|4"

so I have to compare these 2 columns(commidty_Code) and output should be

if a new value is added in new file and one value got removed from old file then output in that column should be "2|3|4" 1.e.,

historyfile:
id;commidty_code
1;1|2|3

CurrentFile:
id;commidty_code
1;2|3|4
outputfile:
id,commidty_code
1;1
1;2|3|4

SO should i first normalize the data in the commidty_code and then compare data ?

Suggest any good logic or help me get the output to achive my requirement

Thanks in Advance
Lmit

Re: comparing data in 2 columns

manodwhb — Tue, 12 Mar 2019 10:40:21 GMT

@lmit ,please find the attached code for your sample data.

test_Normalizer.zip

Re: comparing data in 2 columns

lmit — Tue, 12 Mar 2019 10:53:11 GMT

Hi Manohar B,

Thanks for your reply I have seen that you attached the job but your talend version is higher than mine, I use 6.5 so am not able to import your job
what is your talend version or I can have the screenshoots?

Thanks,
Lmit

Re: comparing data in 2 columns

manodwhb — Tue, 12 Mar 2019 10:59:52 GMT

@lmit ,my talend version is TOS 7.1.1.

Please find the below screenshots.

Historical

Current data:-

Re: comparing data in 2 columns

lmit — Tue, 12 Mar 2019 11:19:37 GMT

Thanks a lot Manohar , will implement your logic and will let you know the result

Thanks,
lmit