Error processing resource while parsing XML with '... - Qlik Community

Anonymous · ‎2013-03-19

Hi
I want to parse xml through Talend job.
In my xml contains special characters like"&" as "&" and "<" as "<" ">" as "&gt" "" etc
How to replace this special characters while parsing xml file through Talend?
sample xml
<?xml version="1.0"?>
<Extract>
<Record>
<ID>1</ID>
<NAME>Product 1</NAME>
<ATTS>
<ATT>Me & my attribute</ATT>
<ATT>Another attribute</ATT>
</ATTS>
</Record>
<Record>
<ID>2</ID>
<NAME>Product 2</NAME>
<ATTS>
<ATT>Foo attribute</ATT>
<ATT>Bar <br />attribute</ATT>
</ATTS>
</Record>
<Record>
<ID>3</ID>
<NAME>Product 3</NAME>
<ATTS>
<ATT>John Doe attribute</ATT>
<ATT>Foo & bar</ATT>
</ATTS>
</Record>
</Extract>
Please help me.
Thanks
Chin

Anonymous · ‎2013-03-19

Hi Chin
What's the error do you get? I am able to read this file, print the result on the console and output them to a file.

Starting job test2 at 11:47 20/03/2013.

 connecting to socket on port 3899
 connected
1|Product 1|Me & my attribute
1|Product 1|Another attribute
2|Product 2|Foo attribute
2|Product 2|Bar <br />attribute
3|Product 3|John Doe attribute
3|Product 3|Foo & bar
 disconnected
Job test2 ended at 11:47 20/03/2013.

Shong

Anonymous · ‎2013-03-20

Hi Shong,
I understand your advise.
But,
My files contains with a zip folder named Test199512345.zip
Unzip this folder contains Folder name is TEST-199512345(123456). It contains the xml file name as TEST-199512345(123456)-TT.xml
Here I did the following:
Step 1: Unzip the folder and put it in a temporary folder
Step 2: Rename the folder format as hyphen and removed brackets (). eg: TEST-199512345-123456
Step 3: Rename the file format as hyphen and removed brackets (). eg :TEST-199512345-123456-TT.xml
I achieved Step 1 to Step 3. i used for shell script to remove the special character in folder and file name.
I failed to do while loading xml files into the table, need to replace the letters as
below tag in xml.
<FEEDBACK>
The Definitive Guide we offer a step by step guide on
how to install MongoDB and get it up and running smoothly.
Precompiled binaries are available for Linux, Mac OS X, Windows,
and Solaris. On most platforms you can download the archive from mongodb.org,
inflate it, and run the binary. "there is ink" in Fig. 3 The MongoDB server requires a directory it can write
database files to and a port it can listen for connections on.
The following section covers the entire install on the two variants of system:
Windows and everything else (Linux, Max, Solaris). 200 is A2', A1 > A2 > A3 - A7 is
Precompiled binaries are available for Linux, Mac OS X, Windows,
and Solaris. On most platforms you can download the archive from mongodb.org,
inflate it, and run the binary.
</FEEDBACK>
My Talend job throwing below error:
Exception in component tFileInputXML_1
org.dom4j.DocumentException: Error on line 15 of document : The entity name must immediately follow the '&' in the entity reference. Nested exception: The entity name must immediately follow the '&' in the entity reference.
at org.dom4j.io.SAXReader.read(SAXReader.java:482)
at org.dom4j.io.SAXReader.read(SAXReader.java:365)
at test_loading.test_3_0_load_data_0_1.TEST_3_0_LOAD_DATA.tMysqlInput_1Process(TEST_3_0_LOAD_DATA.java:2635)
at test_loading.test_3_0_load_data_0_1.TEST_3_0_LOAD_DATA$1.run(TEST_3_0_LOAD_DATA.java:17001)
Please help me out
Thanks
Chin

Anonymous · ‎2013-03-20

Hi Chin
I tried to read the above example you gave and it works, I think the error occurs when trying to read other value that contains characters like "&&", for example:
<FEEDBACK>
This is a test example for && characters. hope it will help you!
</FEEDBACK>
A solution is to read the source xml file with tFileInputFullRow line by line, and then replace "&&" with "<!]>" on tMap, for example
<FEEDBACK>
This is a test example for && characters. hope it will help you!
</FEEDBACK>
will be:
<FEEDBACK>
This is a test example for <!]> characters. hope it will help you!
</FEEDBACK>
and output the rows to a new XML file. So that, you are able to read the new XML file without error, the job looks like:
tFilenputFullRow--main--tMap--tFileOutputOutput
|
onsubjobok
|
tFileInputXML--main--tLogRow

Shong

Anonymous · ‎2013-03-20

Hi Shong,
I have many xml files to do it. Its not possible to add each xml <!]>.
I did 3 steps and after that parsing xml and load in a table.
step4 got failed.
I want to do while parsing time itself to resolve.
Please provide me alternative solution.
Thanks
Chin

Anonymous · ‎2013-03-20

Hi Shong,
I tried to use "sed -i "s/&/&/g" *.xml" in talend, and achieved this way passing through parameters.
But I cannot pass all the characters like
"sed -i "s/&/&><'/g" *.xml"
"<" as "<" ">" as "&gt" "" as 'etc
Please provide me the solution.

Anonymous · ‎2013-03-20

Hi Shong,
I have many xml files to do it. Its not possible to add each xml <!]>.
I did 3 steps and after that parsing xml and load in a table.
step4 got failed.
I want to do while parsing time itself to resolve.
Please provide me alternative solution.
Thanks
Chin

The problem is your xml file contains double '&' symbol like "&&", it is "&&" causes the problem, not "&", "<" and "&gt", so you have to change && to be <!]> as I did before your read the xml file with tFileInputXML component, otherwise it always throws this exception.
Shong

Anonymous · ‎2013-03-21

Hi Shong,
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE doc >
<EMPS>
<EMP>
<STAFF>
<EMPCODE>111</EMPCODE>
<EMPDESIG>BA</EMPDESIG>
<DEPT>FIN</DEPT>
</STAFF>
<PERMANENT>
<ADDRESS>
<ADDRCODE>XX</ADDRCODE>
<ADDRCODE>ABCDE</ADDRCODE>
</ADDRESS>
</PERMANENT>
<FEEDBACK>
The Definitive Guide we offer a step by step guide on
how to install MongoDB and get it up and running smoothly.
Precompiled binaries are available for Linux, Mac OS X, Windows,
and Solaris. On most platforms you can download the archive from mongodb.org,
inflate it, and run the binary. "there is ink" in Fig. 3 The MongoDB server requires a directory it can write
database files to and a port it can listen for connections on.
The following section covers the entire install on the two variants of system:
Windows and everything else (Linux, Max, Solaris). 200 is A2', A1 > A2 > A3 - A7 is
Precompiled binaries are available for Linux, Mac OS X, Windows,
and Solaris. On most platforms you can download the archive from mongodb.org,
inflate it, and run the binary.
</FEEDBACK>
</EMP>
</EMPS>
Please explain me how to change && to be <!]> my xml around 300.
Thanks
Chin

janhess · ‎2013-03-21

Where's the &&?
In response to your email, there's no && in the above example and Shong said he could process it ok.

Anonymous · ‎2013-03-21

Please look in my message.
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE doc >
<EMPS>
<EMP>
<STAFF>
<EMPCODE>111</EMPCODE>
<EMPDESIG>BA</EMPDESIG>
<DEPT>FIN</DEPT>
</STAFF>
<PERMANENT>
<ADDRESS>
<ADDRCODE>XX</ADDRCODE>
<ADDRCODE>ABCDE</ADDRCODE>
</ADDRESS>
</PERMANENT>
<FEEDBACK>
The Definitive Guide we offer a step by step guide on
how to install MongoDB and get it up and running smoothly.
Precompiled binaries are available for Linux, Mac OS X, Windows,
and Solaris. On most platforms you can download the archive from mongodb.org,
inflate it, and run the binary. "there is ink" in Fig. 3 The MongoDB server requires a directory it can write
database files to and a port it can listen for connections on.
The following section covers the entire install on the two variants of system:
Windows and everything else (Linux, Max, Solaris). 200 is A2', A1 > A2 > A3 - A7 is
Precompiled binaries are available for Linux, Mac OS X, Windows,
and Solaris. On most platforms you can download the archive from mongodb.org,
inflate it, and run the binary.
</FEEDBACK>
</EMP>
</EMPS>

Mr.Shong replied me that
will be:
<FEEDBACK>
This is a test example for <!]> characters. hope it will help you!
</FEEDBACK>

Error processing resource while parsing XML with '&' symbol

Talend Data Integration

v5.x

XML