topic Re: tFilelist Problem - process stops on error in Talend Studio

tFilelist Problem - process stops on error

Anonymous — Mon, 19 Mar 2018 17:51:36 GMT

I have a problem using fFileList. I am using it to read files one by one with it and process each file. A read file sometimes contains invalid data and causes job to break. How would I prevent that in case of invalid data in one file. I would still like other files to get processed?

Do I need to make changes with/in the tFileList.

Re: tFilelist Problem - process stops on error

Anonymous — Mon, 19 Mar 2018 18:35:28 GMT

What do you mean by invalid data? Is it a schema mismatch? If that is the case you can use a tSchemaComplianceCheck to ensure incoming data matches a required schema, length, nullability, etc.

Re: tFilelist Problem - process stops on error

Anonymous — Mon, 19 Mar 2018 20:51:06 GMT

what if you have for example multiple subjobs that read and write to DB. And you also read from an XML file?

Re: tFilelist Problem - process stops on error

manodwhb — Tue, 20 Mar 2018 07:25:50 GMT

i will suggest you to use On Component Error of tFileinputDelimited to tSendmail.so that you will understand that which file is not correct one and even your next file will executed.

Re: tFilelist Problem - process stops on error

Anonymous — Tue, 20 Mar 2018 11:28:35 GMT

What about if error occurs when writting to DB?

Re: tFilelist Problem - process stops on error

manodwhb — Tue, 20 Mar 2018 11:46:00 GMT

if you want to send a mail ,then you can use do the same why on db outpout component.

Re: tFilelist Problem - process stops on error

Anonymous — Tue, 20 Mar 2018 17:28:05 GMT

but if Database component throws an error then tFileList will stop iterating on files. How can I handle that?

Re: tFilelist Problem - process stops on error

manodwhb — Wed, 21 Mar 2018 04:23:19 GMT

since your db component throwing error means ,you should fix the error to load that data right? if your current file is not proper format then use that on component error on the db component to email component.

Re: tFilelist Problem - process stops on error

manodwhb — Tue, 03 Apr 2018 10:26:30 GMT

did it help you?