Hi There, I am using the custom components tFileWorkbookOpen, tFileExcelSheetList, tFileExcelSheetInput to read in large excel (xlsx) files each is roughly 16kb - 30mb. I keep getting the java heap space error (out of memory) when the file is more than 1mb. I have tried increasing the heap space to a staggering 10gigs but it still does not solve it. I'm now trying to read in a sheet at a time and save to.csv but the component will not write anything to the csv file as it bombs out with memory error. I have stripped my job down to the bare minimum (see screenshot) to try and get the component to work but still no luck! I am using Talend Open Studio for Data Integration version 5.6, would the newest version of TOS be able to process it? Anyones advice and guidance will be very much appreciated.
Hi,
Have you tried to allocate more memory to your current Job to see if it works?
Please take a look at a KB article about:
TalendHelpCenter:ExceptionOutOfMemory Best regards
Sabrina
Hi Sabrina,
Thank you for the reply, very much appreciated.
I have allocated 13 gig of memory as a test and it still fails with memory heap error.
I condensed the job to read in the 26mb excel file but only read one sheet and the header data information in as a test, but it failed on that as well! Looks like the tFileExcelWorkBookOpen component is reading in all data and storing it in memory, but i do not understand why it would go over 13gig memory!
