topic Re: tfileexcelsheetoutput / tfileoutputexcel - Writing & Saving issue in Talend Studio

tfileexcelsheetoutput / tfileoutputexcel - Writing & Saving issue

Manigandan_Janarthanan — Fri, 15 Nov 2024 22:52:38 GMT

Description:

I'm able to use the component and job is working fine - while I'm using Less data and writing data in Talend
Issue occurs while im trying to handle -

more than 2 millions records while accessing.

more than 20 sheets in one excel

Job is not executing (i.e. Halt State more than 600 seconds) and also job is not getting finished. Finally needs to Kill the job

Requirement:

need to read the data from DB

writing into different sheet(i.e more than 20 sheets) in one excel

Needs to evaluate the formula.

Performance and execution speeds also matters alot.

need to complete the job within 5 to 7 minutes.

Suggestion : please provide better way to handle and what are best components can be used.

@jolling / @Sabarina please provide some ideas .

Eagerly looking for your response.

Re: tfileexcelsheetoutput / tfileoutputexcel - Writing & Saving issue

wwang — Tue, 31 May 2022 06:16:46 GMT

since 8.0. 1 and 7.3.1-R2021-09, we provide a new function in tfileoutputexcel when you choose:

"Write excel2007 file format (xlsx)" and "Append existing file"

in advanced setting, you can see a "Streaming append" checkbox, please check it if help.

Re: tfileexcelsheetoutput / tfileoutputexcel - Writing & Saving issue

Manigandan_Janarthanan — Tue, 31 May 2022 07:49:51 GMT

we have standard xlsx template tfileexcelworkbookopen to use it.

there is no option - "Streaming append" checkbox, we are not using tfileoutputexcel

Re: tfileexcelsheetoutput / tfileoutputexcel - Writing & Saving issue

Manigandan_Janarthanan — Tue, 31 May 2022 07:51:13 GMT

Already im appending the files - to write several excel sheet -

issue occurs - while writing several sheets in excel

memory issue also occurs

Re: tfileexcelsheetoutput / tfileoutputexcel - Writing & Saving issue

wwang — Tue, 31 May 2022 09:26:49 GMT

What's your studio version? the function appear since 8.0. 1 and 7.3.1-R2021-09, in tfieoutputexcel. And you need to check "Write excel2007 file format (xlsx)" and "Append existing file" and "Streaming append" all.

And if you use other custom excel component, no knowledge about it.

Re: tfileexcelsheetoutput / tfileoutputexcel - Writing & Saving issue

Manigandan_Janarthanan — Fri, 30 Sep 2022 08:43:31 GMT

I'm using tFileexcelsheetoutput (i.e. using some template) to use the same format.

memory issue are big problem.

some times the job is completing its will go to hang state.

Please suggest some ideas and it will be more helpful for me.

Re: tfileexcelsheetoutput / tfileoutputexcel - Writing & Saving issue

Manigandan_Janarthanan — Fri, 30 Sep 2022 08:44:59 GMT

why the talend is unable to process more than 10 millions records ? any other better compoents to read data from sql server database and to put in excel sheet