Skip to main content

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
On-Demand Webinar: Learn proven best practices for a smooth transition to Qlik Sense® SaaS. REGISTER

Add parquet as a data format for Microsoft Azure Databricks endpoint

joelm777
Contributor III
Contributor III

Add parquet as a data format for Microsoft Azure Databricks endpoint

joelm777_0-1635781651517.png

Please add parquet as a “target storage format”

Sequence may be faster than text, but it also cannot be easily maintained when the cdc table (__ct) is wanted for long term storage. Many small files are created and slow reads result when hitting the endpoint target tables. Parquet has more flexibility for maintenance and streaming. This can help performance and usability of the replicate endpoint, speeding up Qlik Compose views, etc.

Tags (1)
3 Comments
TimGarrod
Employee
Employee

Thanks for the ideation. 

This feature is on the roadmap for both Replicate DELTA (use parquet as the transient file structure) and for Replicate Databricks (Non-Delta) endpoint that is used with Compose. 

Status changed to: Open - On Roadmap
mehmet_gencsoy
Luminary
Luminary

Any timeline for that feature?

JCJnr
Contributor III
Contributor III

Is this on the cards for the next release ? or when could we expect this?