preventing duplicates with condition in Talend job

[sbxr]

FYI @shong 

Hi,

i have a scenario to handle  please help.

i am having two fields maxName and maxId in table for which based on condition i need to prevent duplicates entering the output flow.

Scenario 1: If maxName is same then keep maxId as it is to the output flow but if the  maxName is different then blankout the maxId,maxCODE fields , same as output shown below: how can i achieve this please help.

Input:

maxName	maxId	maxCODE
Hello	HE	HE
Hello	HE	HE
Jello	JE	JE
xyz	JE	JE

Output:

maxName	maxId	maxCODE
Hello	HE	HE
Hello	HE	HE
Jello	JE	JE
xyz	NULL	NULL

Regards

[manodwhb]

@sbxr , you can try to use with variables in tMap.

[TRF]

Local tMap variables or tMemorizeRows + tJavaFlex should help for your case.

Remember than local tMap variables are evaluated in the same order they are defined for each input record.

So you can compare current row fields with preceding if you declare the required set of variables.  

[sbxr]

Hi @manodwhb

Thanks for the reply, i am not able to apply the solution ,if possible please help me using a demo job.

Thanks