Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
sardarabdullahkhawar
Contributor II
Contributor II

Execution dependency between Replica jobs

Hi all,

Can we schedule Replica execution jobs according to dependency like we do for dags in airflow?

Thanks,

1 Reply
Heinvandenheuvel
Specialist III
Specialist III

Replicate itself only offers simple time based scheduling, think Linux cron jobs. No dependencies no status checks or even finish checks for prior jobs.

Scheduling is typically only useful for Full-Load only tasks. Does the design call for that? 

The dominant Replicate usage and it's claim to fame is near real-time ongoing Replication. Set and forget!

It's tasks are data streams, not the usual programming building blocks which might  conditionally run.  

There is a command line (repctl) and an (enterprise manager provided) RestApi which could be used to start and stop tasks based on time and conditions but those are just primitives and you'd have to provide a lot of work to for example declare success or failure or still running for prior steps.

Good luck!

DAG/airflow sample explanation: https://docs.astronomer.io/learn/dag