topic Re: invalid XML character (unicode: 0xB) while reading file in Talend Studio

invalid XML character (unicode: 0xB) while reading file

Anonymous — Tue, 18 Jun 2019 20:23:20 GMT

Hello!

I have a job which is initiated by wehook and which loads xml source file into sql table when user uploads the xml file. The job looks like

now in one of the file I get this error while running this job.

how can i have them replaced? by using tReplace?

Regards

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Wed, 19 Jun 2019 03:05:39 GMT

Hi Priya,

In short, if my understanding is right, you are having an issue due to unwanted character set in your input file.

What is the allowed character set in your input file. From your screen shot, I could see that its one of the European languages (apologies for my ignorance to recognize the language). So if you could share a problematic sample data and the expected output, we can try to do some experiments around it.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Wed, 19 Jun 2019 09:00:46 GMT

Hello @nthampi

In the screenshot you can see the character . But error I get is this:

org.xml.sax.SAXParseException; lineNumber: 1633168; An invalid XML character (Unicode: 0xc) was found in the element content of the document.

Regards

Priya

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Wed, 19 Jun 2019 09:14:35 GMT

Here is what I am getting in my file : ff form feed ctrl-l

\x{C}

ff form feed ctrl-l

014

0xC

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Wed, 19 Jun 2019 16:25:02 GMT

Hi,

In tReplace Advanced mode you can replace using regex pattern.

Please check the attachment.

Thanks and Regards,

Subhadip

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Thu, 20 Jun 2019 09:07:41 GMT

@subhadip13 Thank you for your reply. Could you post a pic of whole job? I want to know where to place this treplace. Because my problem is the XML file is really very big.

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Thu, 20 Jun 2019 15:20:10 GMT

Hi @priyadarshiniv

Please read the file line by line as a full string using tFileInputFullRow -> tReplace -> tFileOutputDelimited for the cleansed file.

This flow will not use lot of memory as it will be line by line operation.

Thanks and regards,

Subhadip

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Thu, 20 Jun 2019 15:24:39 GMT

Hello @subhadip13

Thank you again for your reply. But my issue is the file is uploaded via an application on a sharepoint location and this XML job is triggered via webhook. So when users uploads the file then it triggers this job. In this case how will this tFileOutputDelimited can be used? where will i store?

Regards

Priya

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Thu, 20 Jun 2019 15:27:40 GMT

Hi @priyadarshiniv

In your job, before the processing with tFileInputXML you can cleanse the file by reading the XML with tFileInputFullRow -> tReplace-> tFileOutputDelimited (Cleansed File) [Cleansed Job] -> OnSubjobOk -> your main job of processing where the tFileInputXML will point to the cleansed file created in the cleansed job.

Thanks and Regards,

Subhadip

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Thu, 20 Jun 2019 15:55:12 GMT

yes. i got the flow, but in tFileOutputDelimited, dont i need to specify the path for the output file? but since I am loading the xml from sharepoint, i dont know where this tFileOutputDelimited output to store?

Regards

Priya

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Thu, 20 Jun 2019 15:56:49 GMT

Hi @priyadarshiniv

You can store the Output file in your local directory and use the same in your job.

Thanks and Regards,

Subhadip

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Thu, 20 Jun 2019 16:07:30 GMT

Hi @subhadip13

I cant! the job runs via management console so it cant use any personal spaces.

Regards

Priya

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Thu, 20 Jun 2019 23:29:17 GMT

hello @subhadip13

I trid your solution, but it gives me error:

Detail Message: The method replaceAll(String, String, String) in the type StringUtils is not applicable for the arguments (Object, String, String)

Regards

Priya

Re: invalid XML character (unicode: 0xB) while reading file

Anonymous — Mon, 24 Jun 2019 17:34:36 GMT

Hi Priya,

Please refer my comment in the below post for reference.

https://community.talend.com/t5/Design-and-Development/Replacing-invalid-xml-character-Unicode-0xc/m-p/165229/highlight/false#M100473

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂