Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Talend Cloud AWS EU Scheduled Outage: Starting Tues 26 May 21:00 CEST with expected completion Wed 27 May 01:00 CEST
cancel
Showing results for 
Search instead for 
Did you mean: 
sardarabdullahkhawar
Contributor III
Contributor III

Execution dependency between Replica jobs

Hi all,

Can we schedule Replica execution jobs according to dependency like we do for dags in airflow?

Thanks,

1 Reply
Heinvandenheuvel
Specialist III
Specialist III

Replicate itself only offers simple time based scheduling, think Linux cron jobs. No dependencies no status checks or even finish checks for prior jobs.

Scheduling is typically only useful for Full-Load only tasks. Does the design call for that? 

The dominant Replicate usage and it's claim to fame is near real-time ongoing Replication. Set and forget!

It's tasks are data streams, not the usual programming building blocks which might  conditionally run.  

There is a command line (repctl) and an (enterprise manager provided) RestApi which could be used to start and stop tasks based on time and conditions but those are just primitives and you'd have to provide a lot of work to for example declare success or failure or still running for prior steps.

Good luck!

DAG/airflow sample explanation: https://docs.astronomer.io/learn/dag