Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
We're currently in the process of migrating our on-prem Talend 6.3 installation to Talend Cloud. Many of our jobs rely on file triggers to kick off tasks through the TAC. I've seen methods for using Lambda triggers for sending event notifications from S3 for the Cloud, but we will still have jobs that depend on files being dropped into mapped network folders for a while.
I've created on-prem Remote Engines and they work fine for manually running or scheduled jobs. They're necessary to access local data sources on our network and write to databases still on-prem.
I don't see an option to create anything like a file trigger in Talend Cloud. Is there a way for a task in TMC to monitor something like \\server\share\folder\file.txt and start when the file is dropped into the folder?
Unfortunately, that's the method for triggering off Cloud storage. I'm looking for File Trigger functionality from previous versions of Talend. We have a local network storage device that has a share into which files are dropped. For our migration, before we get everything into AWS, we will be running remote engines on our local network monitoring local network folders.