Currently there is below limitation when using Microsoft Azure Databricks Delta target endpoint..,
Parallel Load is not supported with the Microsoft Azure Databricks Delta target endpoint.
--> This is not helpful when doing Full-Load for big tables which are not completing (Full-Load) taking days (More than a week sometime which is not ideal and cannot complete the full load due to other maintenance dependencies on the object) instead of hours which we were able to do using the Snowflake on Azure connector.
Attached Screenshot about this limitation from Qlik Replicate for our reference as well!
This is a great request and we are planning on adding this feature as we continue to enhance our Databricks target endpoint. Also included are Databricks SQL support, parquet file etc.
We will keep you posted as these become available.
NOTE: Upon clicking this link 2 tabs may open - please feel free to close the one with a login page. If you only see 1 tab with the login page, please try clicking this link first: Authenticate me! then try the link above again. Ensure pop-up blocker is off.
