Hi, My scenario is that I am getting 100 source files on a daily basis in a specific folder. I have used a tfilelist component to read all the files. One day I received 98 files 2 files are missing or got delayed. How can I check which files are missing before processing the job? Is there any Component in Talend which can identify the missing source files. Also how can I send the alert about those missing files.
If the files all have a specific name, you can store a list of the expected values and compare to the actuals. Otherwise, you can compare the count of files found to the expected value and send an email if the count varies. We would need more specific details to be more helpful.
I am not sure if you have control over the system which is sending the files. You can ask them to send a flag file at the end of the process of sending all the files. that way in case flag file is missing it means that file transfer is still in progress.
Else in case if # of files is constant (in your case 100), then you can check for # of files in your directory before proceeding further.
am also having same scenario.Do you get any solution for this.please let me know if you find solution.
Thanks,
Poorna Sekhar
@rchinta wrote:
Hi,
My scenario is that I am getting 100 source files on a daily basis in a specific folder. I have used a tfilelist component to read all the files.
One day I received 98 files 2 files are missing or got delayed. How can I check which files are missing before processing the job? Is there any Component in Talend which can identify the missing source files. Also how can I send the alert about those missing files.
