topic Re: iterating files using tFileList only processes last file in Talend Studio

iterating files using tFileList only processes last file

reinier1 — Sat, 16 Nov 2024 04:29:57 GMT

I have the following config:

tFileList > iterate > tFileInputPositional > Schemacheck > tMap > tFileOutputDelimited

There are 2 files in the file list. when running the job it states '2 execs finished' on the iterate connector. However, from tFileInputPositional, only the last file is processed.

What am I missing?

Re: iterating files using tFileList only processes last file

TRF — Wed, 02 Oct 2019 12:33:56 GMT

Can you share tFileInputPositional and tFileInputPositional settings?

Re: iterating files using tFileList only processes last file

reinier1 — Wed, 02 Oct 2019 12:51:42 GMT

Like this?

Re: iterating files using tFileList only processes last file

TRF — Wed, 02 Oct 2019 13:50:37 GMT

Nothing special in the settings.
Are you sure both files have the same schema?

Re: iterating files using tFileList only processes last file

reinier1 — Wed, 02 Oct 2019 14:17:01 GMT

I found the issue(s):

- The row count after the tFileInputxx is the rowcount of the last file, not the total

- I had been playing with the 'append' option of the tFileOutputxxx. It was greyed out for me and said that the property was managed by the Repository (where I could not find that option at ll). When I switched the Property Type from Repository to Built-In *and back*, now I could select Append, and I find all my records in the outputfile.

Thanks for the (moral) support.