topic Re: How to remove special characters in the string in Data Quality

How to remove special characters in the string

Anonymous — Sat, 16 Nov 2024 08:50:42 GMT

Hi Folks,

I am new to Talend and need one help from you guys.

How to remove the special character in a string field?

Like for example I have the input like -> 988788-99999

How do I get the output like below,

98878899999

Regards,

Deepak

Re: How to remove special characters in the string

Anonymous — Thu, 18 Jan 2018 09:11:20 GMT

Hello,

In DataPrep, there is a function called "Remove non alpha numeric characters".

Best regards,

Vincent

Re: How to remove special characters in the string

Anonymous — Thu, 18 Jan 2018 09:17:01 GMT

Hi Vincent,

I don't see anything as such in expression builder.

Would you please show me with screen shot?

Re: How to remove special characters in the string

Anonymous — Thu, 18 Jan 2018 09:42:33 GMT

Hello Deepak1,

if you are using Talend Open Studio, you can use tReplace in your job. In advanced mode, you can provide a regular expression.

Once you have a regular expression, that matches your 'special characters', you can replace them with an empty string.

Here is the link to the tReplace help : https://help.talend.com/reader/hm5FaPiiOP31nUYHph0JwQ/jh3P41SE4Or9NQ0J0Gkfsg

Best regards,

Vincenty

Re: How to remove special characters in the string

TRF — Thu, 18 Jan 2018 14:10:15 GMT

Hi,

Using a tMap with the following expression you should get the expected result:

row1.inputField.replaceAll("\\D", "")

This will replace each non-digit character by nothing.

Here is a link to regular expression tutorial http://www.vogella.com/tutorials/JavaRegularExpressions/article.html

Hope this helps.

Re: How to remove special characters in the string

joe86 — Wed, 12 Dec 2018 05:02:02 GMT

Hi All, @TRF, @manodwhb, @nthampi

Can you please tell me how to replace below characters with empty string:

"*éÉÇçÀà~@%#ÀÁÂÃÄÅÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖÙÚÛÜÝàáâãäåçèéêëìíîïðñòóôõöùúûüýÿ/!@#$%?*()+"

My Input value is : Column1 = "*éÉÇçÀà~@%#ÀÁÂÃÄÅÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖÙÚÛÜÝàáâãäåçèéêëìíîïðñòóôõöùúûüýÿ/!@#$%?*()+This is the value"

My required Output is: Column1 = "This is the value"

How to do this? please help.

Re: How to remove special characters in the string

Anonymous — Wed, 12 Dec 2018 05:46:47 GMT

@joe86

I believe you already got the way forward in the below post?

https://community.talend.com/t5/Design-and-Development/Remove-special-Characters-from-a-column-value/m-p/144706#M89090

Warm Regards,

Nikhil Thampi

Re: How to remove special characters in the string

yashfreaky — Mon, 28 Jan 2019 11:06:55 GMT

Input value is : "*éÉÇçÀà~@%#ÀÁÂÃÄÅÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖÙÚÛÜÝàáâãäåçèéêëìíîïðñòóôõöùúûüýÿ/!@#$%?*()+Hi this is Yash"

Required Output is: Hi this is Yash

For this tMap Expression is: row.column.replaceAll("[^a-zA-Z]", " ").trim()

So that it can remove special characters and it gets only alphabetic data (small a-z and CAPITAL a-z).

And .trim() function is to remove blank spaces.

Thanks and Regards

Yashwanth

Re: How to remove special characters in the string

Muhammad_irtiza — Sun, 31 Jan 2021 09:48:26 GMT

HI @Fred Trebuchet

I want to replace comma from a column of csv file.

Like i have field "f,lactuation" i need to convert it into "f lactuation"

i have tried row1.inputcolumn.replaceAll(",", " ") in tmap and in tjavarow but got no change.