idea Re: Use lower cost Databricks "Job Compute" rather than All-Purpose clusters - Status changed to: Open - On Roadmap in Suggest an Idea

Use lower cost Databricks "Job Compute" rather than All-Purpose clusters

joelm777 — Tue, 02 Nov 2021 14:27:41 GMT

Databrick's DBU pricing is tied in part to the compute type you use. All-purpose compute is the most expensive. The least expensive is job compute. Please offer the ability to utilize job compute to run Compose jobs. On the Premium platform, it could reduce customer's DBU costs by almost half!

Azure Pricing - Databricks

Re: Use lower cost Databricks "Job Compute" rather than All-Purpose clusters - Status changed to: Open - On Roadmap

TimGarrod — Wed, 02 Mar 2022 14:44:43 GMT

Thank you for the submission. We do have a feature on the roadmap for Replicate (Delta and Non-Delta endpoints) and Compose to support lower cost compute on databricks.

Since Compose and Replicate both execute sparkSQL against databricks, the current plan is to support databricks SQL endpoints as the compute layer.

SQL endpoints also provide a big reduction in cost on databricks as well as upcoming features like their Unity catalog for fine-grained access control.

Re: Use lower cost Databricks "Job Compute" rather than All-Purpose clusters - Status changed to: Delivered

TimGarrod — Fri, 30 Dec 2022 16:51:36 GMT

Qlik Compose now supports Databricks SQL Warehouse as the lower cost alternative to all-purpose clusters.