OutOf memory when "append to existing file" option checked

[Anonymous]

Hi,

I created a Job that reads a. csv file line by line and reorganizes data using a tMap. Then I save data to a new Excel file (created by talend) using a tFileOutputExcel. The job works perfectly.
The problem appears when I want to add data to an existing excel file (even empty the problem is present). So in tFileOutputExcel, I check the options "Append to existing file" and "add to the existing sheet." The first 100,000 lines will be processed and gradually the flow will decrease and then stagnate and finally will cause me a memory error.
I have already tested the increase of memory with Xms arguments in the "Advanced Settings" and in the preferences of Talend ... It does not solve the problem because the number of lines is too important. And this solution is not suitable since this number is likely to increase further ...
I also try to divide the data into several temporary files that I loaded one after the other but it does not work eather ...
What I do not understand (and if you have an explanation I am all ears) is that when I uncheck both options and I save these 350,000 lines in a file created by Talend, it works very well and it is extremely fast!
Do you have a solution or an explanation? Thx

[Anonymous]

The memory saving mode works only if you create a file from scratch. If you read in, this mode does not work. I am working on a way to build files with sheets and combine them later together. Building very large excel files needs memory.
What error do you got? Please post the stack trace.

[Anonymous]

I am also facing same issue. Any solution for this one?