Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
rishind
Contributor III
Contributor III

AWS S3 file check

Hi ,

I am reading files from AWS S3 bucket.

There is no fix arrival timing for the files .

So as a file arrive ,I want to trigger the job.

How can I achieve this in Talend? Is there any component like tfileexist?

Labels (3)
3 Replies
Anonymous
Not applicable

Hello

There is no a tS3FileExist component, you can try to use tinfiniteLoop+tS3list to check if files exist at regular intervals, then process the file and delete it if needed.

Regards

Shong

rishind
Contributor III
Contributor III
Author

@Shicong Hong​  thanks for replying

In my case ,i cannot schedule it at an interval

It has to trigger whenever a file arrive .(without delay)

Files can arrive in 1 minute or 5 minutes or 7 minutes.

so there is no fixed schedule.

Anonymous
Not applicable

I think you need to find a way to monitor the S3 file, see the discussions in this page. Obviously Talend is not such a tool. What talend components can do is upload, download or delete S3 files.