Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Pasha23
Contributor
Contributor

Duplicate data in columns

Hello,

 

I'm trying to migrate an input MySQL "user" table to the output PostgreSQL table "users" . There are 2 rows with the same e-mails as in the input and output column "e-mail". In my case I want to keep (do not overwrite) this 2 rows in the output table and migrate everything else except these 2 lines.

Is there any scenario or any solution to handle that?

Thank you.

Sorry for my English.

Labels (2)
3 Replies
manodwhb
Champion II
Champion II

@Jan Pashkovski​ , you can remove duplicate data in column using tUniquerow check the below link to know more about this component.

 

https://help.talend.com/r/KxVIhxtXBBFymmkkWJ~O4Q/WMSEmE_brnaTeFF4njGXYQ

 

Thanks,

Manohar

Pasha23
Contributor
Contributor
Author

Hello Manohar,

thank you a lot. I will try it.

 

Best regards.

Pasha23

Pasha23
Contributor
Contributor
Author

Hello Manohar,

know my job looks:

 

MysqliNPUT>>tConvertType>>tMap>>tUniqueRow>>PostgreSQLOutput>>tLogRow

 

But I still can't avoid an error for duplicate key value email: in output table email: xxx@xxx.xx allready exist....

Can I migrate only data wich are not duplicate?

Thank you in advance.

Bet regards.