topic Re: Duplicate data in columns in Talend Studio

Duplicate data in columns

Pasha23 — Fri, 29 Jan 2021 15:03:44 GMT

Hello,

I'm trying to migrate an input MySQL "user" table to the output PostgreSQL table "users" . There are 2 rows with the same e-mails as in the input and output column "e-mail". In my case I want to keep (do not overwrite) this 2 rows in the output table and migrate everything else except these 2 lines.

Is there any scenario or any solution to handle that?

Thank you.

Sorry for my English.

Re: Duplicate data in columns

manodwhb — Mon, 01 Feb 2021 04:26:12 GMT

@Jan Pashkovski , you can remove duplicate data in column using tUniquerow check the below link to know more about this component.

https://help.talend.com/r/KxVIhxtXBBFymmkkWJ~O4Q/WMSEmE_brnaTeFF4njGXYQ

Thanks,

Manohar

Re: Duplicate data in columns

Pasha23 — Mon, 01 Feb 2021 13:45:29 GMT

Hello Manohar,

thank you a lot. I will try it.

Best regards.

Pasha23

Re: Duplicate data in columns

Pasha23 — Mon, 01 Feb 2021 16:24:30 GMT

Hello Manohar,

know my job looks:

MysqliNPUT>>tConvertType>>tMap>>tUniqueRow>>PostgreSQLOutput>>tLogRow

But I still can't avoid an error for duplicate key value email: in output table email: xxx@xxx.xx allready exist....

Can I migrate only data wich are not duplicate?

Thank you in advance.

Bet regards.