I have been using the talend subscription version( talend cloud). I now have a requirement where my job has to be triggered as soon as a file is available in amazon s3. So my question is does talend cloud have support for event based triggers? If not how do you suggest implementing this?
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂
I have set up s3 to send notifications to SQS and my Talend Job is also able to receive messages from the queue , parse the JSON and get the name of the file uploaded in s3.
Im looking for help/suggestion on how to trigger this job(which will eventually be deployed on talend cloud) as soon as a file becomes available on s3. Is it possible only by involving lambda in between?
Lambda is the best triggering mechanism in your case. End of day you are trying to build an event based triggering mechanism and Lambda is a service whose primary purpose is to handle this situation.
Unfortunately I will not be able to check the details of the solution right now. I would suggest to get the help of Talend professional services in this case since its a one off setup operation.
Warm Regards, Nikhil Thampi
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂
