Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I've got a small Talend job that takes data from one table in SQL Server and puts it into Snowflake. The problem is that the job was failing with an error: GC overhead limit error. I increased the JVM argument to
-XX:-UseGCOverheadLimit
Now the job just sits there and never finishes. The table has a little less than 3.5M rows.
Increase the JVM to maximun, atleast 8G, if not before loading it from sql to snowfalke use tMap
in tMap we have an option to to store on disk, configure in a server or local, like 200000 rows, then the intermediate file will be generated and then it can process and load Data to the output. it can resolve this GC oveload