topic Re: OutOfMemory Exception in Talend Studio

OutOfMemory Exception

Anonymous — Mon, 15 Apr 2019 16:25:29 GMT

Hello,

I have an OutOfMemoryError exception when I'm processing on a table with 1000000 rows. Could you help me ?

The configuration of my job is: tOracleInput-> tMap-> tOracleOutput

I am new on TOS and sorry for my English because I am French.

Thank you

Guen

Re: OutOfMemory Exception

Anonymous — Mon, 15 Apr 2019 16:50:41 GMT

There will lot many reasons for memory issues, increase a -xmx to 4g or more then that, according to RAM

Refer to below links for more info

https://community.talend.com/t5/How-Tos-and-Best-Practices/Better-way-to-handle-bulk-load-to-database-and-also-can-resolve/m-p/151087?advanced=false&author_id=19335&collapse_discussion=true&filter=authorId&q=memory&search_type=thread

https://community.talend.com/t5/Design-and-Development/GC-overhead-limit-error-when-running-Jobs-in-Studio/m-p/153212/highlight/false#M93585

Re: OutOfMemory Exception

Anonymous — Mon, 15 Apr 2019 16:52:33 GMT

You have a couple of choices of how to solve this. The first is to focus on the memory of the tMap (https://help.talend.com/reader/EJfmjmfWqXUp5sadUwoGBA/J4xg5kxhK1afr7i7rFA65w). The second way is to adjust the memory assigned to the job (https://help.talend.com/reader/93olCfmQi615MRwYBjy30g/chVspuZjtzXb9Q9HRZKjtw).

Re: OutOfMemory Exception

Anonymous — Tue, 16 Apr 2019 10:14:15 GMT

Hello @ rhall_2_0 thank you for your help,

I opted for the first choice, I focused on the memory of tMap and I did what is asked. Now I have this error. I do not know how to fix it.

Capture.PNG

Re: OutOfMemory Exception

Anonymous — Tue, 16 Apr 2019 10:26:05 GMT

This is strange. When you were having memory issues, I assume the job was running and got through a number of rows before it failed? Does the job run at all now, or is this error shown straight away? Also, could you show a screenshot of your job?

By the way, thanks for the screenshot of the errors, but it would be much easier to work with if you included errors as text. You can copy and paste from the output window 🙂

Re: OutOfMemory Exception

Anonymous — Tue, 16 Apr 2019 13:26:41 GMT

Yes, the job went through a certain number of lines before it failed. It blocks while loading "STG_OT". Here is the screenshot of my work. Thank you

Thank you

Re: OutOfMemory Exception

Anonymous — Tue, 16 Apr 2019 13:50:32 GMT

OK, but does it just error straight away now or does it error when it is loading data from SGT_OT? Also, can you run this again and copy (as text) the whole error stack?