topic Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space in Talend Studio

exception in thread "main" java.lang.OutOfMemoryError: Java heap space

SMahadevan1608028474 — Fri, 29 Jan 2021 13:15:17 GMT

Even after adding JVM parameter still am getting this error.

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

Prakhar1 — Fri, 29 Jan 2021 14:09:03 GMT

did you add

-XX:-UseGCOverheadLimit

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

SMahadevan1608028474 — Fri, 29 Jan 2021 16:53:08 GMT

Yes, I have added already in Jvm arguments -XX:-UseGCOverheadLimit

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

David_Beaty — Sun, 31 Jan 2021 17:15:03 GMT

Sounds like you have components in use that are holding all the data rows in memory whilst it's running. Look for things like:

tUniqRow
tSortRow
tMap
tAggregate

Ensure you've enabled the use of disk to perform actions on.

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

SMahadevan1608028474 — Mon, 01 Feb 2021 10:57:34 GMT

Thanks for your reply on this. Here I am using only Tmap and SchemaComplianceCheck components. Therefore If I want to enable to use disk space... where in Talend? if it is my system I have enough space in my disk.

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

David_Beaty — Mon, 01 Feb 2021 17:19:29 GMT

Hi,

In the tMap component, if you select it only (don't double click) there's a field in the Basic settings as to the path to the "Temp data directory path". You use put in a context variable here to dynamically adjust where the files go or just put a fixed path.

Thanks

David.

If these answers are useful, don't forget to give Kudos

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

SMahadevan1608028474 — Tue, 02 Feb 2021 09:25:43 GMT

I have set the path in Temp Data directory path for tMap component.The files are getting generated in specified path even though am getting the error once the job complete. (Ref: Heap Memory.jpg)

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

David_Beaty — Tue, 02 Feb 2021 09:41:14 GMT

Hi,

I would suggest you use something like Java Visual VM and monitor the job when its running and see at what point it starts to eat all the memory.

Thanks

David

If these answers are useful, don't forget to give Kudos

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

SMahadevan1608028474 — Tue, 02 Feb 2021 10:18:52 GMT

Is It right path to download https://visualvm.github.io/download.html

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

David_Beaty — Tue, 02 Feb 2021 10:36:18 GMT

It should be part of your Java, if you've got the JDK installed, under the {java JDK home}/bin folder - jvisualvm.exe

Thanks

David

If these answers are useful, don't forget to give Kudos

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

SMahadevan1608028474 — Tue, 02 Feb 2021 14:49:07 GMT

Yes, the exe was under the path what you have mention. But Still am getting the error in Talend, I was just monitor the memory in (Visual VM) after opening the application however I could not trace it. Is it something do I need to configure anything here ?

Re: exception in thread "main" java.lang.OutOfMemoryError: Java heap space

David_Beaty — Thu, 04 Feb 2021 07:54:58 GMT

Run the job locally in studio and have JVisualVM open monitoring the process.....you'll just have to track the job and watch JVisualVM to see where it is when the heap spikes.