Replicating through Qlik Replicate to Databricks SQL Warehouse

SachinB — Tue, 29 Oct 2024 14:18:02 GMT

To successfully configure your S3 storage bucket (staging) on your SQL Warehouse, first follow the instructions outlined in Setting general connection properties (help.qlik.com).

In addition:

Add an instance profile or service principle (IAM user) to your Compute which has access to the S3 storage bucket. This is the same S3 bucket you enter into your Qlik Replicate endpoint for Staging. You can navigate to the Data Access properties section of your SQL Warehouse through your Workspace settings.

Click on your User Name in the upper right corner => Click Settings => Compute => SQL warehouses (Manage).

See:
- Configure a SQL warehouse to use an instance profile
- Connect to Amazon S3
If you choose to use Unity Catalog, you need to add an external storage location for the S3 storage bucket. Again, this is the same bucket you enter in the Replicate endpoint for staging. Unity Catalog is not technically a requirement but if you choose to utilize Serverless we recommend you use Unity instead of the Hive Metastore.

See:
- Create a storage credential for connecting to AWS S3
- Create an external location to connect cloud storage to Databricks

Environment:

Qlik Replicate

article Replicating through Qlik Replicate to Databricks SQL Warehouse in Official Support Articles

Replicating through Qlik Replicate to Databricks SQL Warehouse

Environment: