Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap s
Hi Folks , I'm new with Talend Data Integration .. I'm doing a tMysqlIn-->tSortRow_1-->tUniqRow_1 -->tMysqlOut to remove the duplicated rows ..
The in Table have 8 million rows .. After 20 minutes I get the Error bellow .. Does anyone can help me to figure out ? Runing Localy in nice Server ..
Starting job duplicated at 16:07 31/03/2016.
connecting to socket on port 3527
connected
Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.listIterator(Unknown Source)
at java.util.AbstractList.listIterator(Unknown Source)
at java.util.AbstractSequentialList.iterator(Unknown Source)
at routines.system.RunStat.sendMessages(RunStat.java:261)
at routines.system.RunStat.run(RunStat.java:225)
at java.lang.Thread.run(Unknown Source)
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at com.mysql.jdbc.MysqlIO.nextRowFast(MysqlIO.java:2267)
at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:2044)
at com.mysql.jdbc.MysqlIO.readSingleRowSet(MysqlIO.java:3549)
at com.mysql.jdbc.MysqlIO.getResultSet(MysqlIO.java:489)
at com.mysql.jdbc.MysqlIO.readResultsForQueryOrUpdate(MysqlIO.java:3240)
at com.mysql.jdbc.MysqlIO.readAllResults(MysqlIO.java:2411)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2834)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2832)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2781)
at com.mysql.jdbc.StatementImpl.executeQuery(StatementImpl.java:1569)
at local_project.duplicated_0_1.duplicated.tMysqlInput_1Process(duplicated.java:2875)
at local_project.duplicated_0_1.duplicated.runJobInTOS(duplicated.java:4306)
at local_project.duplicated_0_1.duplicated.main(duplicated.java:4140)
disconnected
Job duplicated ended at 16:13 31/03/2016.
In your job, tUniqRow and tSortRow are cache components consuming two much memory. For a large set of data, try to store the data on disk instead of memory.
