topic Escape Special characters - tWriteJSONField in Talend Studio

Escape Special characters - tWriteJSONField

Anonymous — Fri, 15 Mar 2019 15:20:57 GMT

Getting below mentioned error. source attribute had a value with special character '&'. Due to that i am getting this error in tWriteJSONField.

my requirement is to convert source data to Json file.

Could anyone advise how to escape those special characters without replacing or removing those characters. I mean i want to send the information to target which i am receiving from source.

FATAL TERMS_DATA_EXTRACT_GEN:8131 - tWriteJSONField_1_In nu.xom.ParsingException: Character reference "&# at line 1, column 92

2019-03-15 09:31:04 FATAL TERMS_DATA_EXTRACT_GEN:2896 - tWriteJSONField_1_In nu.xom.ParsingException: Character reference "&# at line 1, column 92

[Fatal Error] :1:92: Character reference "&#

Exception in component tWriteJSONField_1_In

net.sf.json.JSONException: nu.xom.ParsingException: Character reference "&# at line 1, column 92

at net.sf.json.xml.XMLSerializer.read(XMLSerializer.java:331)

Re: Escape Special characters - tWriteJSONField

Anonymous — Fri, 15 Mar 2019 15:28:47 GMT

Hi,

Could you please check the details in this link?

https://stackoverflow.com/questions/19176024/how-to-escape-special-characters-in-building-a-json-string/27516892

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Escape Special characters - tWriteJSONField

Anonymous — Fri, 15 Mar 2019 20:35:51 GMT

Hi Nikhil,

It didn't help... i tried several ways and i am still hitting the same issue.

1) replaced '&' with '//&'

2) TalendString.replaceSpecialCharForXML(input)

Re: Escape Special characters - tWriteJSONField

Anonymous — Sat, 16 Mar 2019 08:43:37 GMT

Hi,

Could you please share 3 or 4 ample input records and expected output record. We will try to fill in the missing part then.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Escape Special characters - tWriteJSONField

pheld — Mon, 14 Sep 2020 09:56:41 GMT

hi @RAVI KOPPARAPU ,

I've come across this problem and found out, that there are even more special ("invisible") characters that are causing problems in the component tWriteJSONField.

I built my own program to delete these unnecessary values. In case you want to keep them try to escape them with backslash:

In the routine I replaced as follows:

public static String removeControlChar(String input) {

input = input.replaceAll("\u0000", ""); //remove control character NUL (hex value 0x00)

input = input.replaceAll("\u0002", ""); //remove control character STX (hex value 0x02)

input = input.replaceAll("\u000b", ""); //remove control character VT (hex value 0x0B)

input = input.replaceAll("\u000e", ""); //remove control character SO (hex value 0x0E)

input = input.replaceAll("\u000f", ""); //remove control character SI (hex value 0x0F)

input = input.replaceAll("\u0010", ""); //remove control character DLE (hex value 0x10)

input = input.replaceAll("\u0003", ""); //remove control character ETX (hex value 0x03)

return input;

}

Re: Escape Special characters - tWriteJSONField

cara_ay — Thu, 30 Sep 2021 01:50:46 GMT

Hi @RAVI KOPPARAPU Just wondering if you had managed to find a solution to this? Would you by any chance remember what the solution was as I am currently experiencing the same issue.

Re: Escape Special characters - tWriteJSONField

gjeremy1617088143 — Fri, 01 Oct 2021 14:01:52 GMT

HI,@Cara Au Yeung could you send an example of the json file wich causing issues ?

Send me love and kudos

Re: Escape Special characters - tWriteJSONField

cara_ay — Sun, 03 Oct 2021 01:48:50 GMT

Hi @guenneguez jeremy Thanks for the offer but I've actually managed to find the cause of the issue. I was querying the MySQL database to genereate the json file. It was the backspace (\b) characters in the MySQL database that were triggering the error in Talend.