topic Re: Handling special characters in Talend Studio

Handling special characters

Anonymous — Sat, 16 Nov 2024 09:45:07 GMT

Hi Guys,

I need to transform special characters like "á" . Whenever i read these characters and create a output file it shows "" . Please help how these characters can be handled and it should be loaded into the output. I am stuck badly with this .

Thanks,

Srinath

Re: Handling special characters

TRF — Mon, 22 May 2017 14:35:39 GMT

Hi,

Try using regex:

row1.theStringYouWishToTransform.replaceAll("[^\\w]", "")

Which means, replace any non-word characters (any character outside from [a-zA-Z_0-9]).

If it doesn't matches with your requirements, you can specifiy the characters to replaced bt yourself:

row1.theStringYouWishToTransform.replaceAll("[àâäéèêëîïôöùûü]", "")

Which means, replace these characters (àâäéèêëîïôöùûü) by nothing.

You just have to complete the list of characters you want to remove.

Re: Handling special characters

Anonymous — Mon, 22 May 2017 14:41:32 GMT

Thanks for the reply.

But my requirement is not to replace special character with empty string. It is to load the special characters to output file/table with same size as input file and data should not get trimmed.

In my case, it is populating special characters as empty string but I want to know how Talend handles special characters.

Thanks

Re: Handling special characters

Anonymous — Mon, 22 May 2017 14:47:18 GMT

Hi @srkalakonda,

I had encountered a similiar issue.

make sure your source and target files are with the same encoding.

If you use UTF-8 character encoding this should not occur.

Cheers!

Gatha

Re: Handling special characters

rsmits — Tue, 26 Sep 2017 10:48:17 GMT

Hi,

I had a similar issue.

I was sending a message to a soap endpoint and Köln was converted as K?ln. This issue didn't occur from the studio but only when I scheduled the standalone job as a scheduled task.

This is how I fixed it: http://talendhowto.com/2017/09/02/add-encoding-batch-file/

Re: Handling special characters

Anonymous — Wed, 27 Sep 2017 03:05:22 GMT

Usin utf-8 as encodin gpage will solve the problem and in case of latin characters to be existed u have to override the JVM parameters with utf parameter also.

Re: Handling special characters

ravir — Sun, 22 Oct 2017 18:54:00 GMT

Hello,

Could you please give details on how did you resolve it. I am still getting ? mark if I get any ' mark in my excel source

thanks

Ravi

Re: Handling special characters

Anonymous — Thu, 22 Feb 2018 08:30:09 GMT

been able to solve the problem by edit the *.bat file in a notepad and adding -Dfile.encoding=utf8 after the java word,it works. thanks a lot mate