topic Append Unique Duplicates with sequence Numbers in Talend Studio

Append Unique Duplicates with sequence Numbers

Anonymous — Sat, 16 Nov 2024 03:51:26 GMT

Hi,
i have problem with duplicate data but there'a a way to avoid this duplicated. by add new sequence data for each data.
example :
Name
AA
AA
AA
BB
CC
DD
DD
i need.
Name_IncrementalSequence
AA
AA_1
AA_2
BB
CC
DD
DD_1
How could i proceed? Please help.
Thanks,

Re: Append Unique Duplicates with sequence Numbers

TRF — Thu, 12 Dec 2019 06:48:39 GMT

You can archive this with tMap.
Define a tMap local variable called ind (or anything else) of type int with the following expression:
Numeric.sequence(row1.name,0,1)
A New sequence will be created for each distinct name with a starting value of 0.
On the tMap output flow, use the following expression for name:
Var.ind > 0 ? row1.name + "_" + Var.ind : row1.name
Not tested but should work

Re: Append Unique Duplicates with sequence Numbers

TRF — Sun, 15 Dec 2019 10:24:36 GMT

Did this help?
If so, thanks to mark your case as solved (Kudos also very appreciated).