topic Re: Setting a File Trigger using FTP? in Talend Studio

Setting a File Trigger using FTP?

AndyBrown — Sat, 16 Nov 2024 13:25:26 GMT

I have up to 20 data feeds coming from various sources via FTP. I would like to trigger each respective job using a file trigger, so when a file comes in within X minutes, the trigger detects the presence of the file and fires the job. I notice that in Job Conductor I can only set a file trigger that resides on an app server.
Any suggestions to keep this simple?

Re: Setting a File Trigger using FTP?

Anonymous — Wed, 26 May 2010 03:14:05 GMT

Hello

I notice that in Job Conductor I can only set a file trigger that resides on an app server.

In a job, uing a ftp component to get the fiels on local folder, and using a twaitForFile to monitor the folder, fires a processing once a new file is created.
Best regards
Shong

Re: Setting a File Trigger using FTP?

AndyBrown — Thu, 27 May 2010 11:29:23 GMT

Thank you for the response. To confirm, should I use the tWaitForFile as the first component in my job? Originally I had a tFTPFileExists that found if the file was there then the rest of the job would complete, otherwise it would error out and send an email stating the file isn't there.

Re: Setting a File Trigger using FTP?

Anonymous — Thu, 27 May 2010 11:39:37 GMT

Thank you for the response. To confirm, should I use the tWaitForFile as the first component in my job?

yes, it will fires the rest of the job if a new files is created in the monitored folder.

20 data feeds coming from various sources via FTP.

What do you mean you have 20 data feeds? They are different ftp server?
tWaitForFile--iterate---the rest of the job.

Best regards
Shong

Re: Setting a File Trigger using FTP?

AndyBrown — Thu, 27 May 2010 11:52:11 GMT

Thank you for the response. To confirm, should I use the tWaitForFile as the first component in my job?

yes, it will fires the rest of the job if a new files is created in the monitored folder.

20 data feeds coming from various sources via FTP.

What do you mean you have 20 data feeds? They are different ftp server?
tWaitForFile--iterate---the rest of the job.

Best regards
Shong

Sorry for the mis-understanding. Each job processes just one file. Here is what I had prior to introducing the tWaitForFile...