topic Re: Removing Special Characters in Talend Studio

Removing Special Characters

sszzxx — Sat, 16 Nov 2024 07:00:10 GMT

Hi All,

I am currently trying to import data from a csv file with Chinese Characters and there are some � in the csv file..

My question is how do I import the data into teradata without it giving the "The string contains an untranslatable character," error message.

I would like to either remove the � or just replace it with an empty space.

Please help!

Thanks in advance.

Re: Removing Special Characters

Anonymous — Thu, 20 Dec 2018 04:27:12 GMT

Hi,

You can remove all non-Latin characters by using below function in a tmap.

row2.input_data.replaceAll("[^\\x00-\\x7F]", "")

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Removing Special Characters

sszzxx — Thu, 20 Dec 2018 06:52:35 GMT

Hi Nikhil,

But if that's the case, my chinese character words (such as 小姐) will also be an empty string right?

I just want to remove those garbled letters such as ... ''

thanks.

Re: Removing Special Characters

Anonymous — Thu, 20 Dec 2018 06:55:39 GMT

Ok. In that case, could you please go to the advanced settings of the tfileinput component and convert the language settings to UTF-8.

The symbols are getting generated due to wrong language set. You can remove the tMap in this case.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂