Skip to main content

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
Welcome Talend Customers and Partners! Feature requests are now entered here. ABOUT IDEATION

Add parquet as a data format for Microsoft Azure Databricks endpoint

joelm777
Contributor III
Contributor III

Add parquet as a data format for Microsoft Azure Databricks endpoint

joelm777_0-1635781651517.png

Please add parquet as a “target storage format”

Sequence may be faster than text, but it also cannot be easily maintained when the cdc table (__ct) is wanted for long term storage. Many small files are created and slow reads result when hitting the endpoint target tables. Parquet has more flexibility for maintenance and streaming. This can help performance and usability of the replicate endpoint, speeding up Qlik Compose views, etc.

Tags (1)
5 Comments
TimGarrod
Employee
Employee

Thanks for the ideation. 

This feature is on the roadmap for both Replicate DELTA (use parquet as the transient file structure) and for Replicate Databricks (Non-Delta) endpoint that is used with Compose. 

Status changed to: Open - On Roadmap
mehmet_gencsoy
Luminary Alumni
Luminary Alumni

Any timeline for that feature?

JCJnr
Contributor III
Contributor III

Is this on the cards for the next release ? or when could we expect this?

Meghann_MacDonald

From now on, please track this idea from the Ideation portal. 

Link to new idea

Meghann

NOTE: Upon clicking this link 2 tabs may open - please feel free to close the one with a login page. If you only see 1 tab with the login page, please try clicking this link first: Authenticate me! then try the link above again. Ensure pop-up blocker is off.

Ideation
Explorer II
Explorer II
 
Status changed to: Closed - Archived