Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
We have a workflow consisting of multiple ETL tasks. Each task processes several interrelated entities. Currently, Compose does not provide a checkpoint feature, so if a task fails, rerunning the job starts from the beginning instead of resuming from the point of failure. This leads to repeated execution of completed steps, resulting in longer runtimes and increased resource consumption. Could you suggest a solution for this? Splitting into one task per entity is not an option for us.
If I had to choose just one data integration tool for a project requiring continuous data movement across both on-premises and cloud environments, I would choose Qlik Data Integration (QDI).