Skip to main content

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
This page is no longer in use. To suggest an idea, please visit Browse and Suggest.

Reading Data From .parquet and .gz format files

Karthikb
Contributor II
Contributor II

Reading Data From .parquet and .gz format files

We have a requirement to read data from a compressed file like .parquet and .gz format files. If we have this option will be really helpful.

Tags (2)
4 Comments
Ian_Crosland
Employee
Employee

Hi

Parquet file support is planned for early 2023

Thanks

Ian

Status changed to: Open - In Development
PabloLabbeImaps
Partner Ambassador
Partner Ambassador

It would be great to read data stored primary for datalake usage, now be accessible directly in Qlik Sense.

cookiejest
Partner - Contributor III
Partner - Contributor III

Hi! Yes, we recently built a tool to do direct streaming of data to Qlik from Parquet files using the standard Qlik REST connector called Cloudslurp.

Just create an account and link your S3 bucket, Dropbox or upload your Parquet file. Then you can start doing SQL based queries to the file and then use the standard REST connector in Qlik to load data into your app. It has the added benefit of being able to filter down large Parquet files to smaller data sets so you can significantly reduce your app reload time.

The API call you use in the Qlik REST connector looks like this:

https://api.cloudslurp.com/data?token=YOURTOKENHERE&query=SELECT * FROM cldslp1."yellow_tripdata_2022-01.parquet";

You can copy and paste this for your exact data set by clicking on the 'Code' button:

cookiejest_0-1673623502516.png

 

 

Meghann_MacDonald

This feature has now been partially delivered with parquet file support.

Thank you for your contributions! https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Scripting/work-with-parq...

Please raise a new idea for .gz files 

Status changed to: Delivered