topic exception in thread "main" java.lang.outofmemoryerror: java heap space in Talend Data Catalog

exception in thread "main" java.lang.outofmemoryerror: java heap space

AKumari1638191085 — Fri, 15 Nov 2024 23:28:22 GMT

I am trying to load a table(74 Columns, 3420971 Rows) from PostgreSQL Server to SQL Server but getting an exception in thread "main" java.lang.outofmemoryerror: java heap space. I have already tried multiple blog suggestions but couldn't manage to load the table.

Is there any way that we can migrate such heavy tables?

Urgent response would be much appreciated.

Thanks in advance.

Re: exception in thread "main" java.lang.outofmemoryerror: java heap space

Anonymous — Tue, 30 Nov 2021 03:28:21 GMT

Hello,

Please ensure that you give the right amount of heap space that is allotted to the machine but also enough for the job to run successfully. Ensure that the job has high enough memory and modify the -Xmx accordingly.

Here is a KB article about: Could not reserve enough space for object heap exception

Hope it helps.

Best regards

Sabrina

Re: exception in thread "main" java.lang.outofmemoryerror: java heap space

AKumari1638191085 — Fri, 14 Jan 2022 10:11:53 GMT

I followed the same as suggested in the above mentioned article but it didn't worked.

Re: exception in thread "main" java.lang.outofmemoryerror: java heap space

Anonymous — Mon, 17 Jan 2022 03:04:26 GMT

Hello,

From your screenshot, you are using a buffer tMap component. Please try to store temporary data on disk rather than in memory and allocate more memory to one job not for the whole studio.

For more information, please refer to this KB article

https://community.talend.com/s/article/OutOfMemory-Exception-WmtmQ

Best regards

Sabrina

Re: exception in thread "main" java.lang.outofmemoryerror: java heap space

Anonymous — Tue, 15 Feb 2022 08:52:09 GMT

Everything is very open with a clear description of the issues. It was truly informative. Your website is very helpful. Many thanks for sharing!