AWS S3 file check

[rishind]

Hi ,

I am reading files from AWS S3 bucket.

There is no fix arrival timing for the files .

So as a file arrive ,I want to trigger the job.

How can I achieve this in Talend? Is there any component like tfileexist?

[Anonymous]

Hello

There is no a tS3FileExist component, you can try to use tinfiniteLoop+tS3list to check if files exist at regular intervals, then process the file and delete it if needed.

Regards

Shong

[rishind]

@Shicong Hong​  thanks for replying

In my case ,i cannot schedule it at an interval

It has to trigger whenever a file arrive .(without delay)

Files can arrive in 1 minute or 5 minutes or 7 minutes.

so there is no fixed schedule.

[Anonymous]

I think you need to find a way to monitor the S3 file, see the discussions in this page. Obviously Talend is not such a tool. What talend components can do is upload, download or delete S3 files.