Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
With this release, organizations running API and Route workloads that were previously restricted to “Remote Engines” (Gen1) can now seamlessly deploy, manage, and run all use cases at scale on Dynamic Engine - while enjoying the benefits of container-native infrastructure, advanced scaling, and zero downtime operations
Full Feature Parity & Cloud-Native Advantages
Dynamic Engine now covers all Data Fabric use cases, including:
- Data Integration (batch & real-time jobs)
- Big Data workloads
- Data Services (APIs)
- Camel/ESB Routes
This achieves full parity with Remote Engine Gen1, while adding new strengths such as dynamic scaling options and simplified operations.
Feature Support | Remote Engine (Gen1) | Dynamic Engine |
Data Integration | ✅ | ✅ |
Big Data* | ✅ | ✅ |
Data (API) Services | ✅ | 🆕 |
(Camel/ESB) Routes | ✅ | 🆕 |
Scaling options | ⛔️ | 🆕 |
Lightning-fast, Frictionless Deployment
It has never been easier to build and deploy Data/API Services on Kubernetes, using Dynamic Engine:
- Prepare your Engine: Set up Dynamic Engine environments in a few clicks, leveraging powerful Helm-based customization.
- Build & Publish: Use Talend Studio to develop your Data Service or Route, then publish to Qlik Talend Cloud.
- One-click Deploy: Deploy your API or route, request scaling, and monitor live - all inside Talend Management Console.
- Observe & Control: Always-on monitoring at the replica and deployment level, with live metrics for troubleshooting.
You no longer have to script or configure parallel instances to handle uptimes or traffic peaks - Dynamic Engine takes care of orchestration and resource management automatically.
No-downtime, Always-on Workloads
One of the game-changers with Dynamic Engine is the modern, Kubernetes-native rolling update strategy. Whether you’re updating a Data Service, deploying a new version of a Camel Route, or simply scaling out the number of replicas, Dynamic Engine ensures:
- Zero production downtime: The rolling update process keeps previous replicas serving traffic while new ones start, with smooth traffic handover.
- No-disruption upgrades: Maintenance windows become obsolete. You can deploy updates or scale up during peak hours with confidence.
- 24/7 readiness: Your API and service workloads remain available, even when scaling or updating - critical for real-time and regulated workloads.
Here’s a step-by-step description of the rolling update process for deploying a new version of an API service in Dynamic Engine, as illustrated in the image
This diagram illustrates how Dynamic Engine performs seamless version upgrades using Kubernetes-native rolling updates:
- Step 1: All replicas run the current version (v1), serving traffic normally.
- Step 2: A new replica (v2) is added while v1 replicas remain active.
- Step 3: One v1 replica is replaced with v2, maintaining uninterrupted service.
- Step 4: All replicas now run v2, completing the transition with no service downtime.
Please note that disruptive changes in the API services (or Route) definition shouldn’t be re-deployed this way, as consumers may not request the older and newer API services using the same API contract.
Built for Scalability
Dynamic Engine introduces intelligent, configurable scaling for all workload types:
- Static and Automatic scaling: Choose a static number of service replicas (greater or equal to one) or set automatic min/max rules based on resource utilization via HELM custom values.
- Smart resource allocation: The engine intelligently provisions compute based on demand, even during peak periods.
- Microservice deployment: Each service or route runs as an independent, isolated container, reducing resource contention and enabling efficient scale.
Seamless Transition – No Additional Subscriptions Needed
Best of all, Dynamic Engine’s expanded support for Data Services and Camel Routes is already available to all Qlik Talend Cloud and Talend Cloud customers - no changes in contract or subscription required. Simply set up your Dynamic Engine environment and start running API services at scale today.
In short: Dynamic Engine truly brings Talend’s API and data service runtime into the cloud-native era: no more legacy constraints, no more deployment headaches, no business downtime - just effortless, scalable, and reliable integration.
Are you an existing user? Your Cloud subscription already entitles you to all these features - start taking advantage of scale and zero-downtime now!