topic Getting error while parsing XML file in talend ESB 6.4.1 in Talend Studio

Getting error while parsing XML file in talend ESB 6.4.1

Paritosh1 — Sat, 16 Nov 2024 01:17:52 GMT

Hi All,

Getting error while parsing XML file using tFileInputXML component. Exception in thread "main" java.lang.OutOfMemoryError: Java heap space.

XML size is 800 MB.

Please help to resolve this issue.

Thanks in advance!

Re: Getting error while parsing XML file in talend ESB 6.4.1

Anonymous — Thu, 22 Oct 2020 07:39:11 GMT

Hello,

What's the size of your considering input source XML File? What you can do now is trying to reduce the consumption of memory and increase the arguments of JVM?

Any tmap component in your job design?

Best regards

Sabrina

Re: Getting error while parsing XML file in talend ESB 6.4.1

Paritosh1 — Mon, 26 Oct 2020 05:59:24 GMT

Thanks for your help!

Current file size is 800 MB and we are expecting to process maximum file 5 GB.

Yes, tMap is used to moved the data in Table.

Re: Getting error while parsing XML file in talend ESB 6.4.1

Anonymous — Wed, 28 Oct 2020 11:06:44 GMT

Hello,

If there is tMap component in your job, you need to use "Store on disk" feature.

Best regards

Sabrina

Re: Getting error while parsing XML file in talend ESB 6.4.1

Paritosh1 — Thu, 29 Oct 2020 14:13:44 GMT

Thanks for your reply!

Can you please explain in which component I need to use this ("Store on disk" feature) . I am not very clear about that. Your help will be much appreciated.

Re: Getting error while parsing XML file in talend ESB 6.4.1

Paritosh1 — Thu, 29 Oct 2020 14:13:44 GMT

Thanks for your reply!

Can you please explain in which component I need to use this ("Store on disk" feature) . I am not very clear about that. Your help will be much appreciated.

Re: Getting error while parsing XML file in talend ESB 6.4.1

Anonymous — Mon, 02 Nov 2020 09:40:26 GMT

Hello,

You can use this "Store on disk" feature in tMap component which is a cache component consuming too much memory.

For more information, please have a look at this community article: https://community.talend.com/s/article/OutOfMemory-Exception-WmtmQ

Best regards

Sabrina

Re: Getting error while parsing XML file in talend ESB 6.4.1

Paritosh1 — Mon, 02 Nov 2020 10:29:40 GMT

Hello,

In this example there are two row (row1 and row2) table in tMap but in my case I have only one input xml row set in tMap. What i need to do in this case.

Re: Getting error while parsing XML file in talend ESB 6.4.1

Anonymous — Wed, 04 Nov 2020 09:23:57 GMT

Hello,

Could you please post your current job design here? What's your purpose of using tMap component in your work flow?

Best regards

Sabrina

Re: Getting error while parsing XML file in talend ESB 6.4.1

Paritosh1 — Wed, 04 Nov 2020 11:29:05 GMT

Thanks for your reply!

I need to parse XML file and move the data into SQL server table. This is the flow of my Job.

Re: Getting error while parsing XML file in talend ESB 6.4.1

Anonymous — Thu, 05 Nov 2020 08:53:59 GMT

Hello,

The screenshots of your job flow is not available on community. could you please have a look at it?

Best regards

Sabrina

Re: Getting error while parsing XML file in talend ESB 6.4.1

Paritosh1 — Fri, 06 Nov 2020 16:45:34 GMT

Hello,

Please find attached job design