Skip to main content
Announcements
Live today at 11 AM ET. Get your questions about Qlik Connect answered, or just listen in. SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
raadwiptec
Creator II
Creator II

parquet Files

Any leads/suggestions how to read parquet Files from Qliksense? 

Labels (1)
1 Solution

Accepted Solutions
Alexis_Touet
Former Employee
Former Employee

Hi @raadwiptec 

You could use apache drill / ODBC.
To preview the data and select columns you will need to use SQL query in your script or a paid  plugin by Cdata.

Hope this helps

Please don't forget to mark a correct resolution or answer to your problem or question as correct, as it will help other members to find solutions more easily 😉

View solution in original post

6 Replies
Alexis_Touet
Former Employee
Former Employee

Hi @raadwiptec 

You could use apache drill / ODBC.
To preview the data and select columns you will need to use SQL query in your script or a paid  plugin by Cdata.

Hope this helps

Please don't forget to mark a correct resolution or answer to your problem or question as correct, as it will help other members to find solutions more easily 😉
cookiejest
Partner - Contributor III
Partner - Contributor III

Hi! Yes, we recently built a tool to do direct streaming of data to Qlik from Parquet files using the standard Qlik REST connector called Cloudslurp.

Just create an account and link your S3 bucket, Dropbox or upload your Parquet file. Then you can start doing SQL based queries to the file and then use the standard REST connector in Qlik to load data into your app. It has the added benefit of being able to filter down large Parquet files to smaller data sets so you can significantly reduce your app reload time.

The API call you use in the Qlik REST connector looks like this:

https://api.cloudslurp.com/data?token=YOURTOKENHERE&query=SELECT * FROM cldslp1."yellow_tripdata_2022-01.parquet";

You can copy and paste this for your exact data set by clicking on the 'Code' button:

Screenshot 2023-01-13 at 15.13.27.png

 

diagonjope
Partner - Creator II
Partner - Creator II

Hi @raadwiptec ,

For what it might be worth, it seems tha QSe can now handle Parquet files:

https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Scripting/work-with-parq...

Cheers,

++José

TusharDev_Qlik
Creator II
Creator II

Hi Alexis,

Could you please advise on using Apache Drill which is in built available with QS installation ?

Any external ODBC driver we need to install as an alternative solution to load .parquet files?

marksouzacosta
Partner - Creator II
Partner - Creator II

Qlik supports Parquet files since release August 2023:
https://help.qlik.com/en-US/sense/February2024/Subsystems/Hub/Content/Sense_Hub/Scripting/work-with-...

Get hooked on Qlik at qlikbait.net