We are getting incredible poor performance on using the append option on the component tAdvancedOutputXML. The first XML is created from a CSV source and looks something like with one loop called Race and looks like below. The second source is a CSV that has the ID field and another loop element (reason we can't use the MSXML because it appends all loops to the bottom where we need race in the middle). The append actually appends to the top under id instead of the bottom in 4.0.3 and 4.2.3, however, in 4.2.2 it works correctly. The problem is the append runs at like .01 rows per second. We really need this append to run much quicker. Any ideas? Have tried temp directories, buffer increase, etc. Right now, running XP on 4 gig memory, 32 bit, but soon going to 64 bit, 8 gig memory. Also, need to open a bug on 4.2.3 in which the append doesn't appear to work..appends to top of student instead of the bottom like 4.2.2 does.
<Student id="SID_71346">
<StudentUniqueStateId>71346</StudentUniqueStateId>
<StudentId>764750431</StudentId>
<LocalId>71346</LocalId>
<Name>
<FirstName>Marguerite</FirstName>
<LastSurname>Lindline</LastSurname>
</Name>
<Race>
<RacialCategory>White</RacialCategory>
<RacialCategory>Hispanic</RacialCategory>
</Race>
<BirthData>
<BirthDate>2004-03-15</BirthDate>
<BirthCity>Trenton</BirthCity>
<BirthCountry>United States</BirthCountry>
<BirthState>TX</BirthState>
</BirthData>
<LimitedEnglishProficiency>Limited</LimitedEnglishProficiency>
We tried this approach and it seems job is taking 200 secs for 1000 rows and for 10,000 rows it's freezing. Is there any other way in Talend which can help merging three separate files into one file?
Hi
You can try the tXMLMap component that allows you to define a Document and set multiple loop elements, link it to a tFileOutputXML to generate a XML file.
Shong
Shong,
Do you know, why tXMLMAP is not allowing multiple loops? None of the approach is working right now and this issue is production critical. Can you suggest some other way to fix this issue?