topic Re: Encoding UTF-8 and ISO-8859 in Talend Studio

Encoding UTF-8 and ISO-8859

Anonymous — Wed, 03 May 2017 17:17:21 GMT

Hello,

I would like to encode in Encoding UTF-8 and ISO-8859 because all characters in data with accent (é ; à ; è ; etc.) = "?"

I saw that we can change in advanced settings but i don't have...

Someone can help me ?

Thank you.

Version of Talend :Talend Open Studio for Data IntegrationVersion: 6.3.1

Re: Encoding UTF-8 and ISO-8859

TRF — Wed, 03 May 2017 17:44:02 GMT

Encoding is for files, not for db components.

Re: Encoding UTF-8 and ISO-8859

Anonymous — Thu, 04 May 2017 08:42:52 GMT

Thanks TRF for your answer.
Can I force encoding in the database connectors ?
I use 2 databases connectors : firebird and General JDBC (Microsoft Azure).

Re: Encoding UTF-8 and ISO-8859

TRF — Thu, 04 May 2017 08:47:20 GMT

No (I don't think so).

Depending on the engine, the charset is choosen when the database is created.

Re: Encoding UTF-8 and ISO-8859

Anonymous — Fri, 05 May 2017 01:20:13 GMT

If you are having trouble with charsets, you can try fixing this using a bit of Java.

String broken_nordic = "HÃ¤r Ã¤r nÃ¥gra merkkejÃ¤";
byte[] bytes = broken_nordic.getBytes("ISO-8859-1");  
String fixed_nordic = new String(bytes,"UTF-8");

This *should* produce the following text .....

"Här är några merkkejä"

Test it and if that works you can create a reusable routine to make it easier to use

Re: Encoding UTF-8 and ISO-8859

Anonymous — Fri, 05 May 2017 11:10:54 GMT

The SQL Server uses SQL_Latin1_General_CP1_CI_AS charset but I don't understand when I insert directly rows it takes into account special characters ...

I think the unique solution is to create a new database with adequate charset.

Re: Encoding UTF-8 and ISO-8859

Anonymous — Fri, 05 May 2017 11:12:09 GMT

Thanks rhall_2_0 for your answer but i'm a newbie lol.
It's a little bit complicated for me .