topic Re: tFileExcelWorkbookOpen Java heap space error in Talend Studio

tFileExcelWorkbookOpen Java heap space error

Anonymous — Fri, 12 Feb 2016 01:22:24 GMT

Hi There,
I am using the custom components tFileWorkbookOpen, tFileExcelSheetList, tFileExcelSheetInput to read in large excel (xlsx) files each is roughly 16kb - 30mb. I keep getting the java heap space error (out of memory) when the file is more than 1mb. I have tried increasing the heap space to a staggering 10gigs but it still does not solve it.
I'm now trying to read in a sheet at a time and save to.csv but the component will not write anything to the csv file as it bombs out with memory error. I have stripped my job down to the bare minimum (see screenshot) to try and get the component to work but still no luck!
I am using Talend Open Studio for Data Integration version 5.6, would the newest version of TOS be able to process it?
Anyones advice and guidance will be very much appreciated.

Re: tFileExcelWorkbookOpen Java heap space error

Anonymous — Mon, 15 Feb 2016 03:49:30 GMT

Hi,
Have you tried to allocate more memory to your current Job to see if it works?
Please take a look at a KB article about: TalendHelpCenter:ExceptionOutOfMemory
Best regards
Sabrina

Re: tFileExcelWorkbookOpen Java heap space error

Anonymous — Tue, 16 Feb 2016 21:14:31 GMT

Hi Sabrina,
Thank you for the reply, very much appreciated.
I have allocated 13 gig of memory as a test and it still fails with memory heap error.
I condensed the job to read in the 26mb excel file but only read one sheet and the header data information in as a test, but it failed on that as well! Looks like the tFileExcelWorkBookOpen component is reading in all data and storing it in memory, but i do not understand why it would go over 13gig memory!

Gary