We need Azure AD support for Azure Databricks endpoints using Service Principal. We cannot use Databricks tokens.
Our security standards require AAD authentication using Service Principal, which is not supported for the Databricks connection and is only supported for the staging ADLS.
We would also like to go one step further and support retrieving the secret from an Azure Keyvault rather than hardcoding it into the connector configuration.