topic Re: GC overhead limit exceeded in Talend Studio

GC overhead limit exceeded

Anonymous — Sat, 16 Nov 2024 08:29:13 GMT

Hi,

I'm trying to load 30 MB of excel file to oracle database. Its a direct load no transformation.

But still am getting error GC overhead limit exceeded and sometimes java heap space.

It should not come because Job will be reading record by record from file am putting in DB, but what is the meaning of this error at this point ? I'm not storing in memory or somewhere else, just a direct load.

Job Deisgn

tfileinputexcel----->toracleoutput

Any suggestion please ?

Re: GC overhead limit exceeded

TRF — Thu, 29 Mar 2018 08:58:10 GMT

Hi,

This may help you http://www.oracle.com/technetwork/java/javase/gc-tuning-6-140523.html#cms.oom

Re: GC overhead limit exceeded

Karuetl — Tue, 19 Mar 2019 17:01:29 GMT

Even i am having the same issue when reading excel file and loading into csv file

I got the same error .. What needs to be done to fix this

Re: GC overhead limit exceeded

akumar2301 — Tue, 19 Mar 2019 17:04:02 GMT

Try advance setting

Less memory consumed for large excel(Event mode):

Re: GC overhead limit exceeded

Karuetl — Tue, 19 Mar 2019 17:09:30 GMT

i gave as below

-Xms256M

-Xmx4G

Re: GC overhead limit exceeded

Karuetl — Tue, 19 Mar 2019 17:39:51 GMT

Abhishek

I used the option you have mentioned, it's working fine

but tfileInputExcel, Sheet(name or position) has to be only in String that is sheet name , it didn't work when i gave 0 or 1

Re: GC overhead limit exceeded

akumar2301 — Thu, 21 Mar 2019 13:08:42 GMT

if it helps ,

you could get the sheetName in tJava before start reading.

Below code in tJava to find 1st sheetname :

org.apache.poi.xssf.usermodel.XSSFWorkbook workbook1 =
new org.apache.poi.xssf.usermodel.XSSFWorkbook(xlsxfilename);

System.out.println(workbook1.getSheetName(0));