Suggest an Idea

[joelm777]

Please add parquet as a “target storage format”

Sequence may be faster than text, but it also cannot be easily maintained when the cdc table (__ct) is wanted for long term storage. Many small files are created and slow reads result when hitting the endpoint target tables. Parquet has more flexibility for maintenance and streaming. This can help performance and usability of the replicate endpoint, speeding up Qlik Compose views, etc.

[TimGarrod]

Thanks for the ideation. 

This feature is on the roadmap for both Replicate DELTA (use parquet as the transient file structure) and for Replicate Databricks (Non-Delta) endpoint that is used with Compose. 

[mehmet_gencsoy]

Any timeline for that feature?

[JCJnr]

Is this on the cards for the next release ? or when could we expect this?

[Meghann_MacDonald]

From now on, please track this idea from the Ideation portal. 

Link to new idea

Meghann

NOTE: Upon clicking this link 2 tabs may open - please feel free to close the one with a login page. If you only see 1 tab with the login page, please try clicking this link first: Authenticate me! then try the link above again. Ensure pop-up blocker is off.