Parquet vs QVD: A Performance and Size Comparison for Qlik Developers

[marksouzacosta]

QVD files have long been the gold standard for Qlik developers, but is Parquet the future?
In this deep dive, we compare file size, load performance, and efficiency.
Discover how Parquet challenges QVD’s dominance and why Qlik’s recent Upsolver acquisition signals a shift toward open data formats. Read more at: 
https://www.datavoyagers.net/post/parquet-vs-qvd-a-performance-and-size-comparison-for-qlik-develope...

Regards,

Mark Costa

[parkera]

Slight segway: If anyone wants a an embedded Qlik DuckDB extension to read Parquet files natively in Qlik Cloud you can get it here: https://differentia.app.box.com/s/374ohip3psd755dq37m2d1egd7sicya6

The extension lets you map a field to your Qlik App and use that to drive the filter on the Parquet file. The file can be refreshed anytime, eg if streamed to, so that you can look at the most recent Parquet file transactions in Qlik. Putting the 'I' in 'BI'. 

Use cases might include IoT, Retail basket analysis etc. Great if you have very large apps in QlikView and want to port to Qlik Cloud. It gives you another way to do this. Best of all it lets you store the data files cheaply in S3.

Note: Extension if free to use, and thus not supported. All software is open source. (WASM, Arrow, DuckDB)

Do share how you use it.

[marksouzacosta]

This is quite interesting @parkera. I'm hearing a lot about DuckDB these days...
By the way, the link you sent is pointing to a login page.

Regards,

Mark Costa

[parkera]

Hi Mark,

Linked updated: https://differentia.app.box.com/s/374ohip3psd755dq37m2d1egd7sicya6 - should work now