topic Re: Read large excel 2007 file in Talend Studio

Read large excel 2007 file

_AnonymousUser — Sat, 16 Nov 2024 12:48:14 GMT

In my project i must load a large excel 2007 file into Oracle DB .. the file is 118 MB with 255000 rows
My component TfileInputExcel can't read and generate an error Java heap space out of memory ... i've set the java parameter Xms2048M and Xmx4096M
There is a way to do that?
Talend Open Studio 4.1.1
Thank in advance
Regards
marco

Re: Read large excel 2007 file

Anonymous — Mon, 18 Jul 2011 10:19:19 GMT

Hi
Do you still have other components such tFilterRow, tMap in the job? Where do you set the JVM parameters?
Best regards
Shong

Re: Read large excel 2007 file

Rishab1 — Wed, 27 Oct 2021 02:33:43 GMT

Hi , Saw this post is this issue somehow solved as i also have a similar problem ...i want to read excel files with records more than 200k or even more & size is around 65mb-200mb , what is the process for reading these files in talend i am running into java heap space error , i have tried increasing the jvm parameters but getting the same error.

Is there any resolution to this.

Re: Read large excel 2007 file

Anonymous — Wed, 27 Oct 2021 08:24:47 GMT

@Rishab Raghav , try the tFileExcel components shared by jlolling on Talend Exchange, read only a certain number of rows at a time by set the Row start index （starts with 1) and Limit rows to fields, do a loop to read the file several times until all rows are read, set the Row start index （starts with 1) field with a context variable.