Getting error while parsing XML file in talend ESB 6.4.1

[Paritosh1]

Hi All,

Getting error while parsing XML file using tFileInputXML component. Exception in thread "main" java.lang.OutOfMemoryError: Java heap space.

XML size is 800 MB.

Please help to resolve this issue.

Thanks in advance!

[Anonymous]

Hello,

What's the size of your considering input source XML File? What you can do now is trying to reduce the consumption of memory and increase the arguments of JVM?

Any tmap component in your job design?

Best regards

Sabrina

[Paritosh1]

Thanks for your help!

Current file size is 800 MB and we are expecting to process maximum file 5 GB.

Yes, tMap is used to moved the data in Table.

[Anonymous]

Hello,

If there is tMap component in your job, you need to use "Store on disk" feature.

Best regards

Sabrina

[Paritosh1]

Thanks for your reply!

Can you please explain in which component I need to use this  ("Store on disk" feature) . I am not very clear about that. Your help will be much appreciated.

[Paritosh1]

Thanks for your reply!

Can you please explain in which component I need to use this  ("Store on disk" feature) . I am not very clear about that. Your help will be much appreciated.

[Anonymous]

Hello,

You can use this "Store on disk" feature in tMap component which is a cache component consuming too much memory.

For more information, please have a look at this community article: https://community.talend.com/s/article/OutOfMemory-Exception-WmtmQ

Best regards

Sabrina

[Paritosh1]

Hello,

In this example there are two row (row1 and row2) table in tMap but in my case I have only one input xml row set in tMap. What i need to do in this case.

[Anonymous]

Hello,

Could you please post your current job design here? What's your purpose of using tMap component in your work flow?

Best regards

Sabrina

[Paritosh1]

Thanks for your reply!

I need to parse XML file and move the data into SQL server table. This is the flow of my Job.