comparing data in 2 columns

[lmit]

Hi All,

I have 2 files (one is history file and the other is current file)

the history file has a column called Commidty_Code  and data in this is like "1|2|3"

the current file also has the same data in commidty_code but the current file can have new values add or removed like "1|2|3|4" or "2|3|4"

so I have to compare these 2 columns(commidty_Code) and output should be

if a new value is added in new file and one value got removed from old file then output in that column should be "2|3|4" 1.e.,

historyfile:
id;commidty_code
1;1|2|3

CurrentFile:
id;commidty_code
1;2|3|4
outputfile:
id,commidty_code
1;1
1;2|3|4

SO should i first normalize the data in the commidty_code and then compare data ?

Suggest any good logic or help me get the output to achive my requirement

Thanks in Advance
Lmit

[manodwhb]

@lmit ,please find the attached code for your sample data.

test_Normalizer.zip

[lmit]

Hi Manohar B,

Thanks for your reply I have seen that you attached the job but your talend version is higher than mine, I use 6.5 so am not able to import your job
what is your talend version or I can have the screenshoots?

Thanks,
Lmit

[manodwhb]

@lmit ,my talend version is  TOS 7.1.1.

Please find the below screenshots.

Historical

Current data:-

[lmit · Accepted solution]

Thanks a lot Manohar , will implement your logic and will let you know the result

Thanks,
lmit