topic Re: tFileList duplicating data via multiple iterations in Talend Studio

tFileList duplicating data via multiple iterations

mobmsc2 — Thu, 10 Oct 2019 15:45:54 GMT

I have a data integration job which processes a folder of csv files then moves on to process a folder of excel files using OnSubJobOk.

The csv folder holds 3 files

The excel folder holds 4 files

My problem is when I look at the output from the excel section I have multiple copies of the same content e.g. I have 4 copies of each row in each excel file. What am I doing wrong or is it expected behavior

Re: tFileList duplicating data via multiple iterations

TRF — Thu, 10 Oct 2019 15:50:53 GMT

Share the whole job design

Re: tFileList duplicating data via multiple iterations

mobmsc2 — Thu, 10 Oct 2019 16:02:50 GMT

I'm sorry I can't do that with this project. If you add a tFileOutputExcel to the right of the tFileInExcel and set it so it appends content you will replicate the issue I'm encountering

Re: tFileList duplicating data via multiple iterations

TRF — Thu, 10 Oct 2019 16:16:57 GMT

No one can't guess how it is configured