topic Re: Number of Source Files in Specific folder in Talend Studio

Number of Source Files in Specific folder

Anonymous — Mon, 03 Oct 2016 08:47:08 GMT

Hi,
My scenario is that I am getting 100 source files on a daily basis in a specific folder. I have used a tfilelist component to read all the files.
One day I received 98 files 2 files are missing or got delayed. How can I check which files are missing before processing the job? Is there any Component in Talend which can identify the missing source files. Also how can I send the alert about those missing files.

Re: Number of Source Files in Specific folder

cterenzi — Tue, 04 Oct 2016 19:33:05 GMT

If the files all have a specific name, you can store a list of the expected values and compare to the actuals. Otherwise, you can compare the count of files found to the expected value and send an email if the count varies. We would need more specific details to be more helpful.

Re: Number of Source Files in Specific folder

Anonymous — Wed, 05 Oct 2016 05:07:44 GMT

I am not sure if you have control over the system which is sending the files. You can ask them to send a flag file at the end of the process of sending all the files. that way in case flag file is missing it means that file transfer is still in progress.
Else in case if # of files is constant (in your case 100), then you can check for # of files in your directory before proceeding further.

Re: Number of Source Files in Specific folder

psr — Wed, 31 Jul 2019 12:48:24 GMT

Hi,

am also having same scenario.Do you get any solution for this.please let me know if you find solution.

Thanks,

Poorna Sekhar

@rchinta wrote:
Hi,
My scenario is that I am getting 100 source files on a daily basis in a specific folder. I have used a tfilelist component to read all the files.
One day I received 98 files 2 files are missing or got delayed. How can I check which files are missing before processing the job? Is there any Component in Talend which can identify the missing source files. Also how can I send the alert about those missing files.