topic Re: Umlauts in UTF-8 in Talend Studio

Umlauts in UTF-8

Anonymous — Thu, 24 May 2012 11:02:40 GMT

Hello
I'm transforming an XML file. The source file has umlaut characters which have been converted to their utf-8 equivalents. For example the source file contains:
<TOWNCITY>Düsseldorf</TOWNCITY>
When I transform this into an new XML format, TOS converts this to:
<TOWNCITY>Düsseldorf</TOWNCITY>
I would like to preserve the original, but I can't figure it out. Both the source and the output file are configured to be UTF-8 encoding.
Any ideas how I can achieve this?
Thanks for your help.

Re: Umlauts in UTF-8

Anonymous — Thu, 24 May 2012 11:03:51 GMT

Hmmm.... the character has been converted in the post too. So the original should be:
<TOWNCITY>D & # 2 5 2 ; sseldorf</TOWNCITY>
With spaces, so that it does not convert

Re: Umlauts in UTF-8

Anonymous — Thu, 24 May 2012 11:45:26 GMT

Hi Jonathan,
I think the output of the job should be in the format you specify in the output component. So if your input contains UTF-8 and you read this into Talend it will convert it to an internal format, but when exporting, you should be able to select the desired format again, UTF-8 for example. This should give you a file or table with the correct data.
Hope this helps.
Regards,
Arno

Re: Umlauts in UTF-8

Anonymous — Thu, 24 May 2012 11:53:19 GMT

Arno
Thanks for the reply. I'm doing as you suggest - the source file is read as UTF-8 and the output I create is also UTF-8, but Talend is still converting the data to the umlaut character. Maybe its a bug - I can't find any configuration parameters that will change this.
Jonathan

Re: Umlauts in UTF-8

janhess — Thu, 24 May 2012 12:00:12 GMT

If it's a bug you could get round it by replacing in a tMap or tReplace but it will probably affect a number of characters.

Re: Umlauts in UTF-8

Anonymous — Thu, 24 May 2012 12:48:00 GMT

Yes - I tried to post process it with a tReplace - no luck with this either I'm afraid - it still converts back to the umlaut character.