topic Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql in Talend Studio

tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

lucfarm — Tue, 24 Sep 2019 16:58:20 GMT

Hi everyone,

I inserted 2 components in my Designer area, a tDBInput and a tDBoutput in order to get data from an exernal DB and insert this data into another database.

Both databases have collation utf8_general_ci. I inserted inside the component parameters &characterEncoding=UTF-8 (I tried also &characterEncoding=utf8), but when I check data on my target DB, some fields with non latin characters are written with strange symbols (see the screenshot).

What did i do wrong?

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

Anonymous — Tue, 24 Sep 2019 21:24:33 GMT

Hi,

Could you please add below parameters?

characterEncoding=utf8&characterSetResult=utf8&useUnicode=true

Please read the below post as reference.

https://community.talend.com/t5/Design-and-Development/resolved-Encoding-problems-during-conversion-of-XML-to-MySQL/td-p/109614

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

lucfarm — Wed, 25 Sep 2019 08:57:06 GMT

Hi nikhilthampi,

thank you for your answer.

I tried and followed the post you suggested me, but still not working.

I added the parameters to the component as suggested (see the attached file).

I don't know what I can do...

chars.JPG
design.JPG
parameters_new.JPG

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

Anonymous — Wed, 25 Sep 2019 15:29:00 GMT

Hi,

Could you please print the output to console and see whether its getting extracted from source correctly? If its working fine, could you please add the details to target output too.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

lucfarm — Wed, 25 Sep 2019 16:16:54 GMT

How I can enable the printing of the iutput to the console?

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

Anonymous — Wed, 25 Sep 2019 17:52:41 GMT

Hi,

Please connect the data from tDBInput to a tLogrow to print the data to console.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

lucfarm — Thu, 26 Sep 2019 11:18:54 GMT

Hi,

in the logs the strings are written correctly (with the correct
characters).
I think it's a target Database issue.
I'll figure out the reason why and let you know.

Thank you

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

Anonymous — Thu, 26 Sep 2019 14:13:59 GMT

Perfect!

Please check the language set configured in your target DB. Once its configured for UTF characters, most probably the error will disappear.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

lucfarm — Thu, 26 Sep 2019 15:42:54 GMT

I got it!
I inserted in my.cnf file on the target Database these lines:

[MySQLD]
character-set-client-handshake = FALSE
character-set-server = utf8mb4
collation-server = utf8mb4_unicode_ci

[client]
default-character-set = utf8mb4

[mysql]
default-character-set = utf8mb4

and now all the data are saved in the right way.

We can set this post solved!
Thanks!

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

Anonymous — Thu, 26 Sep 2019 18:38:14 GMT

Thanks for the update.

Could you please mark the posts which have helped you to resolve this issue?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

lucfarm — Fri, 27 Sep 2019 07:21:54 GMT

Hi Nikhil,

none of these posts helped me. I searched on google, but i don't remember
the link where I found the solution. I'm sorry.

Re: tDBinput Mysql writes strange characters (not latin) in tDBOutput mysql

Anonymous — Fri, 27 Sep 2019 14:21:37 GMT

@lucfarm

My request is to mark your own post where you have outlined the solution. This will help other Talend community members during their reference.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved