topic tGreenPlumInput OutOfMemoryError in Talend Studio

tGreenPlumInput OutOfMemoryError

Anonymous — Mon, 05 Mar 2012 17:26:50 GMT

All,
I'm trying to use tGreenPlumInput to export data to other Greenplum table but I get out of memory error.
the table that I'm trying to deal with is about 17 000 000 line
the query is a simple extract
Could you help me to find solution to bypass the issue

error message
Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap space
Exception in thread "main" java.lang.Error: java.lang.OutOfMemoryError: Java heap space
at demo.gpodbc_0_1.gpodbc.tGreenplumInput_1Process(gpodbc.java:1527)
at demo.gpodbc_0_1.gpodbc.runJobInTOS(gpodbc.java:1705)
at demo.gpodbc_0_1.gpodbc.main(gpodbc.java:1573)
Caused by: java.lang.OutOfMemoryError: Java heap space

the jvm is specified with xms256M and xmx1024M
I have windows 7-64bit, 8Go Ram
Best regards
DN

Re: tGreenPlumInput OutOfMemoryError

Anonymous — Tue, 06 Mar 2012 02:07:54 GMT

Hi
Please try this. Set xms and xmx the same.
Regards,
Pedro

Re: tGreenPlumInput OutOfMemoryError

Anonymous — Tue, 06 Mar 2012 10:12:41 GMT

Hi Pedro
same error

Exception in thread "main" java.lang.Error: java.lang.OutOfMemoryError: Java heap space
at demo.alimgp_0_1.AlimGP.tGreenplumInput_1Process(AlimGP.java:1714)
at demo.alimgp_0_1.AlimGP.runJobInTOS(AlimGP.java:1892)
at demo.alimgp_0_1.AlimGP.main(AlimGP.java:1760)
Caused by: java.lang.OutOfMemoryError: Java heap space
at java.lang.Class.getDeclaredFields0(Native Method)
at java.lang.Class.privateGetDeclaredFields(Unknown Source)
at java.lang.Class.getDeclaredField(Unknown Source)
at java.util.concurrent.atomic.AtomicReferenceFieldUpdater$AtomicReferenceFieldUpdaterImpl.<init>(Unknown Source)
at java.util.concurrent.atomic.AtomicReferenceFieldUpdater.newUpdater(Unknown Source)
disconnected
at java.sql.SQLException.<clinit>(Unknown Source)
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1309)
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:192)
at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:451)
at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:336)
at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:235)
at demo.alimgp_0_1.AlimGP.tGreenplumInput_1Process(AlimGP.java:896)
... 2 more
Job AlimGP terminé à 11:02 06/03/2012.

working for other table with less data
DN