topic Re: [Urgent Help Needed Talend Cloud]How to trigger a Cloud Task one instance after another? in Talend Studio

[Urgent Help Needed Talend Cloud]How to trigger a Cloud Task one instance after another?

jerownimow — Sat, 16 Nov 2024 00:45:43 GMT

Hi Folks,

Good day!

I have several tasks in TMC that is scheduled every 5 mins. But for some reason it triggers succeeding instances every 5 mins even though the first instance isn't finished yet (e.g. loading a bunch of records so it won't finish under 5 mins).

As a result, it occupies all the concurrent task limit preventing the other tasks from running and some executions are failing because the limit is already maxed out.

Do we have settings/configurations on TMC same with TAC wherein the next trigger waits for the prior instances to be completed before the succeeding schedules are triggered?

Appreciate your feedback on this.

Thank you.

Re: [Urgent Help Needed Talend Cloud]How to trigger a Cloud Task one instance after another?

David_Beaty — Sun, 07 Feb 2021 12:56:01 GMT

Hi,

What you're after doesn't exist within TMC as far as I'm aware.

What you could do, is to have multiple tasks for a single artefact that are triggered hourly but only at specific times, hh:00, hh:05, hh:10, etc. The first thing the job does is to check some mechanism to indicate it's already running and just exits if it is already running. Otherwise, set the mechanism to say the process is now running.

You'd probably want to build in some control logic that says if it thinks its been running for longer that the maximum allowable time, then the job should alert.

Thanks

David

If you find these answers helpful, don't forget to Like and/or set as the answer