topic Re: Find unique rows in Talend Studio

Find unique rows

paresh1 — Sat, 16 Nov 2024 00:39:06 GMT

Hi All,

Below is the input

name mobile email seg date remark

AAAAA 1234567890 aa@gmail.com a 02-01-2020 a1

BBBBB 1234567890 aa@gmail.com a 03-01-2020 a2

CCCCC 1234567890 aa@gmail.com a 04-01-2020 a3

AAAAA 1234567890 aa@gmail.com a 05-01-2020 a4

DDDDD 1234567890 aa@gmail.com a 06-01-2020 a5

BBBBB 1234567890 aa@gmail.com a 07-01-2020 a6

EEEEEE 1234567890 aa@gmail.com a 08-01-2020 a7

I want unique rows based on "

name, mobile & email"

Required Output:

name mobile email seg date remark

CCCCC 1234567890 aa@gmail.com a 04-01-2020 a3

DDDDD 1234567890 aa@gmail.com a 06-01-2020 a5

EEEEEE 1234567890 aa@gmail.com a 08-01-2020 a7

Thanks in advance : )

Re: Find unique rows

manodwhb — Tue, 09 Feb 2021 11:15:06 GMT

@Paresh Pawar ,check the below example. and you can use tUniquerow.

https://help.talend.com/r/mjoDghHoMPI0yuyZ83a13Q/CytSFvc9E9EvOIKU8pToFQ

Thanks,

Manohar

Re: Find unique rows

JSey — Wed, 10 Feb 2021 02:30:59 GMT

Concatenate the columns for name, email and phone, then use tuniquerow to filter for unique only.

Re: Find unique rows

paresh1 — Wed, 10 Feb 2021 10:23:04 GMT

Thanks @Manohar B

I tried it but output is like

AAAAA 1234567890 aa@gmail.com a Thu Jan 02 00:00:00 IST 2020 a1

BBBBB 1234567890 aa@gmail.com a Fri Jan 03 00:00:00 IST 2020 a2

CCCCC 1234567890 aa@gmail.com a Sat Jan 04 00:00:00 IST 2020 a3

DDDDD 1234567890 aa@gmail.com a Mon Jan 06 00:00:00 IST 2020 a5

EEEEEE 1234567890 aa@gmail.com a Wed Jan 08 00:00:00 IST 2020 a7

whereas I should only get rows for below names as they are unique

CCCCC

DDDDD

EEEEEE

Re: Find unique rows

paresh1 — Wed, 10 Feb 2021 10:25:49 GMT

Thanks @Johnny Sey

tunique is doing distinct but not finding only unique rows

Re: Find unique rows

manodwhb — Wed, 10 Feb 2021 11:53:19 GMT

@Paresh Pawar , you need to sort the data which you wan to get and then use tUniquerow.

as part of sort include date column descending order.

Thanks,

Manohar

Re: Find unique rows

Prakhar1 — Wed, 10 Feb 2021 19:14:29 GMT

You can use the tAggregateRow and use the count function and group by using the 3 columns and then output only those rows whose count is equal 1