topic Re: [resolved] Encoding to UTF-8 miss all latin special characters in Talend Studio

[resolved] Encoding to UTF-8 miss all latin special characters

Anonymous — Sat, 16 Nov 2024 10:32:48 GMT

Hello.
I am trying to get data from Firebird DB, then store it to csv files.
If i create the files with UTF-8, I loose all latin special characters, like "é" or "ã" they will be replaced with "?"
Is there any way to put in UTF-8 without loosing those latin special characters?
Thank you

Re: [resolved] Encoding to UTF-8 miss all latin special characters

Anonymous — Wed, 29 Jun 2016 09:25:57 GMT

Hi,
Could you please try to a dd the "Dfile.encoding=utf-8" to the JVM parameters of job review to see if it works?
Best regards
Sabrina

Re: [resolved] Encoding to UTF-8 miss all latin special characters

Anonymous — Wed, 29 Jun 2016 09:51:07 GMT

Hi Sabrina.
That's what I have.
I also tried with the tencoding component and the result is the same.
File is converted/saved with UTF-8 encoding but all latin characters are replaced with "?"
I am using last TOS, but I have this problem since I Know TOS, from version 4.2.
Any more ideas?

Re: [resolved] Encoding to UTF-8 miss all latin special characters

Anonymous — Mon, 04 Jul 2016 09:40:24 GMT

Hello.
I think it's related with O.S. I am using it in English, but locale, Keyboard, etc are in Portuguese.
Default windows enconding is in cp1252, changed to 65001 (UTF-8) but result it's the same.
I am running out of ideas...Any suggestions?
Thank you

Re: [resolved] Encoding to UTF-8 miss all latin special characters

Anonymous — Mon, 04 Jul 2016 10:28:47 GMT

Hello.
I workaround this by doing this steps:
Changed the windows encoding to 65001 for current user session command and administration session with command line: chcp 65001
Then: All the generated files in the job with "UTF-8" and added JVM argument: Dfile.encoding="cp1252".
All the files now are in UTF-8 with all latin special characters.
I hope this help someone in the future
Thank you!

Re: [resolved] Encoding to UTF-8 miss all latin special characters

Anonymous — Tue, 05 Jul 2016 10:33:59 GMT

Hi,
Great the solution works. Thanks for your feedback and sharing your solution with us.
Best regards
Sabrina