Skip to main content

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Woohoo! Qlik Community has won “Best in Class Community” in the 2024 Khoros Kudos awards!
Announcements
This page is no longer in use. To suggest an idea, please visit Browse and Suggest.

Parquet File Connector

mehmet_gencsoy
Luminary Alumni
Luminary Alumni

Parquet File Connector

Currently on Azure we are not able to directly load Parquet Files to QS.

We need additional tools like Apache Drill. So it will be a very needed feature to be able to load the data directly.

Tags (1)
32 Comments
Ian_Crosland
Employee
Employee

hi

This is still in the early analysis phase and will be built for Qlik Sense SaaS, pending the analysis and subsequent architecture investigations will provide a clearer indication of its applicability for Qlik Sense Client Managed

 

Ian

AlexOmetis
Partner Ambassador
Partner Ambassador

@Ian_Crosland - that's what I assumed, thanks for confirming so quickly! 

mehmet_gencsoy
Luminary Alumni
Luminary Alumni

@Ian_Crosland 

Hi Ian,

we need it for QS Client Managed.

Thanks.

 

BR

Mehmet

dvasseur
Partner - Creator III
Partner - Creator III

FYI, we had the same issue for one of our customers (load parquet files from azure) so I developed a connector for this. It's beta/unfinished/missing options (no preview, load all columns, ...) and quite slow but it's doing the job, customer is happy :). Here is a sample script:

// link to azure blob storage with parquet files

lib connect to 'datalake azure';

// load all parquet files from dataiku/RCU/CUSTOMER/ in dataiku container

select * from dataiku.dataiku/RCU/CUSTOMER/;

As I said, it's quick and dirty, I'll be very happy to replace it with Qlik's one, once published, but for now...

If needed, I could share it (authentication to azure based on shared key only, shared access signature not supported)

korsikov
Partner - Specialist III
Partner - Specialist III

Hi all.

Is there any news when will be released connector s3 parquet for qse CM and QSE saas?

GuilhermeSchneider
Contributor II
Contributor II

Hello,

 

Any news about that parquet file connector?

Ian_Crosland
Employee
Employee

Hi

This is still in a planned state, no current ETA as the team involved working on other priority items, i will post an ETA once we get onto the next stage,   currently alternatives are available via 3rd party layers and ODBC e.g. impala/Athena

Thanks

 

Ian

FilipWuebbeler
Contributor
Contributor

Hi @Ian_Crosland - do you have an update on ETA for the parquet file connector for both CME and QSE SaaS that you could share,  please?

Ian_Crosland
Employee
Employee

Hi @FilipWuebbeler 

We are planning a customer EAP in February on SaaS and the results of this will dictate the GA dates for both CME and QSE SaaS.

If you have any interest in participating in the EAP please contact steven.pressland@qlik.com 

Thanks

Ian

FilipWuebbeler
Contributor
Contributor

Thanks @Ian_Crosland for the update. My colleague Col will be in contact with you for a follow up.