topic GC overhead limit error when running Jobs in Studio in Talend Studio

GC overhead limit error when running Jobs in Studio

Anonymous — Sat, 16 Nov 2024 06:25:19 GMT

I've got a small Talend job that takes data from one table in SQL Server and puts it into Snowflake. The problem is that the job was failing with an error: GC overhead limit error. I increased the JVM argument to

-XX:-UseGCOverheadLimit

Now the job just sits there and never finishes. The table has a little less than 3.5M rows.

Re: GC overhead limit error when running Jobs in Studio

Anonymous — Tue, 05 Mar 2019 21:46:52 GMT

Increase the JVM to maximun, atleast 8G, if not before loading it from sql to snowfalke use tMap

in tMap we have an option to to store on disk, configure in a server or local, like 200000 rows, then the intermediate file will be generated and then it can process and load Data to the output. it can resolve this GC oveload