tfileexcelsheetoutput / tfileoutputexcel - Writing & Saving issue

[Manigandan_Janarthanan]

Description:

1. I'm able to use the component and job is working fine - while I'm using Less data and writing data in Talend
2. Issue occurs while im trying to handle -

more than 2 millions records while accessing.

more than 20 sheets in one excel

Job is not executing (i.e. Halt State more than 600 seconds) and also job is not getting finished. Finally needs to Kill the job

Requirement:

need to read the data from DB

writing into different sheet(i.e more than 20 sheets) in one excel

Needs to evaluate the formula.

Performance and execution speeds also matters alot.

need to complete the job within 5 to 7 minutes.

Suggestion : please provide better way to handle and what are best components can be used.

@jolling / @Sabarina please provide some ideas .

Eagerly looking for your response.

[wwang]

since 8.0. 1 and 7.3.1-R2021-09, we provide a new function in tfileoutputexcel when you choose:

"Write excel2007 file format (xlsx)" and "Append existing file"

in advanced setting, you can see a "Streaming append" checkbox, please check it if help.

[Manigandan_Janarthanan]

we have standard xlsx template tfileexcelworkbookopen to use it.

there is no option - "Streaming append" checkbox, we are not using tfileoutputexcel 

[Manigandan_Janarthanan]

Already im appending the files - to write several excel sheet -

issue occurs - while writing several sheets in excel

memory issue also occurs

[wwang]

What's your studio version? the function appear since 8.0. 1 and 7.3.1-R2021-09, in tfieoutputexcel. And you need to check "Write excel2007 file format (xlsx)" and "Append existing file" and "Streaming append" all.

And if you use other custom excel component, no knowledge about it.

[Manigandan_Janarthanan]

I'm using tFileexcelsheetoutput (i.e. using some template) to use the same format.

memory issue are big problem.

some times the job is completing its will go to hang state.

Please suggest some ideas and it will be more helpful for me.

[Manigandan_Janarthanan]

why the talend is unable to process more than 10 millions records ? any other better compoents to read data from sql server database and to put in excel sheet