utf8mb4 configuration tmysql

[Anonymous]

Hi, 

I have been trying for days to insert data such smileys, data from all languages into mysql through talend.

The source is sql server and target mysql.

If I use the 'Set Names utf8mb4' in mysql and run my insert statements, the data is successfully inserted. (Ex - ハウス, is inserted correctly)

However, if I set the  'Set Names utf8mb4'  in additional parameters, it just does not work (ハウス is inserted as ???)

As of now, its tmssqlinput - tmysqlbulkoutputexec

Any idea on how to solve this?

[lojdr]

Hi.

I am not sure if I am correct, but By default in Talend is used UTF-8 not UTF-8MB4. I think. you need to convert the text to UTF8MB4.

See e.g. this thread:

https://community.talend.com/t5/Design-and-Development/Encoding-UTF-8-and-ISO-8859/td-p/23158

Hope it helps.

Regards

Lojdr

[Anonymous]

Yes Lojdr. That's my question precisely. Where do I put the statement 'set names utf8mb4'

[lojdr]

"set names utf8mb4" is related to the connection so in Additional JDBC Parameters as character_set_connection.

[Anonymous]

So, in the additional setting I must include character_set_connection = utf8mb4. What about the other character settings for MySQL which must be set to utf8mb4?

[lojdr]

Character set for table definition or at least for the specific column.

[Anonymous]

Hi, this does not work for me until I set the character connection ,server connection to utf8mb4.

The tables and columns are already in utf8mb4

So , I am using the set names utf8mb4, which I am unable to use in taken

[lojdr]

Have you converted the string you are sending to the database to the URF8MB4 encoding?

[Anonymous]

I'm using tmssqlinput. How do I convert the string here to utf8mb4. In the additional parameters of tmssqlinput I have included character encoding = utf8mb4

And, also in tmysqlputput I have included in the additional parameters set names utf8mb4

But, these don't work when the incoming string has a emoji

[lojdr]

I gave you a link to an example how to convert strings from one encoding to another in Talend in my first post. Sorry, I can't help you more.