topic Re: Split a Big XML in Talend Studio

Split a Big XML

Sabrina1657096962 — Wed, 06 Jul 2022 08:55:15 GMT

Hello,

I have to convert a large xml file (>3 GB) to transform it into csv.

I have a memory problems (java heap space). One of the solutions would be to split it but I can't find how to do it. (I use TOS 7.3.1 and not TIS)

Thanks for your help.

Sabrina

Re: Split a Big XML

Anonymous — Wed, 06 Jul 2022 10:22:25 GMT

@Sabrina Chaillou , please take a look at the below relevant page

https://community.talend.com/s/feed/0D53p00007vCwX9CAK

https://stackoverflow.com/questions/700213/xml-split-of-a-large-file

you need to use some tool to split it manually or hard code to do it programmatically(I have never tried, but I'm very interested to hear your feedback if you get a chance to try it)

Regards

Shong