idea Re: Parquet File Connector in Suggest an Idea

Parquet File Connector

mehmet_gencsoy — Tue, 04 Aug 2020 04:51:48 GMT

Currently on Azure we are not able to directly load Parquet Files to QS.

We need additional tools like Apache Drill. So it will be a very needed feature to be able to load the data directly.

Re: Parquet File Connector - Status changed to: Open - Collecting Feedback

Ian_Crosland — Tue, 22 Sep 2020 08:40:52 GMT

Re: Parquet File Connector

domanskij — Tue, 27 Apr 2021 14:23:47 GMT

Yes we need this as well. Especially parquet files are currently more often used in the Cloud when using Databricks.

This will be a huge disadvantage in the Cloud againgst PowerBI. Power BI will get this possibility to load parquet files next month.

Re: Parquet File Connector

jfitz_chicago — Thu, 13 May 2021 20:14:16 GMT

Agreed. We have prospects starting to ask about Parquet files. This would be a great addition - cloud and on-premise.

Re: Parquet File Connector

FrancoisP — Tue, 19 Oct 2021 13:03:58 GMT

CDATA provides SQL-based Access to Parquet through ODBC driver
QlikView is named in the list of solutions that can use the driver. I suppose QlikSense too?

https://www.cdata.com/drivers/parquet/odbc/download/

Re: Parquet File Connector

parkera — Wed, 27 Oct 2021 20:05:13 GMT

Got my vote too. Have access to new tools that create parquet files from various ERP suites, but cannot directly load to Qlik. The connector would therefore be great.

Re: Parquet File Connector

mkl — Thu, 11 Nov 2021 11:27:40 GMT

Hi all, yes I have also customers who have asked for Parquet files connectivity especially when Qlik SaaS connectivity is in question. So I give my votes too to this idea.

Re: Parquet File Connector

mehmet_gencsoy — Tue, 18 Jan 2022 14:59:51 GMT

Any updates?

Mehmet

Re: Parquet File Connector

amrenova — Wed, 09 Feb 2022 08:33:53 GMT

Required feature

Re: Parquet File Connector - Status changed to: Open - On Roadmap

Ian_Crosland — Wed, 09 Feb 2022 08:37:03 GMT

Re: Parquet File Connector

AlexOmetis — Wed, 09 Feb 2022 09:58:19 GMT

@Ian_Crosland - great to see this is on the roadmap now - are you able to clarify if this is for Qlik Sense SaaS, Qlik Sense Client Managed, both or something else (e.g. App Automation / QDI)?

Re: Parquet File Connector

Ian_Crosland — Wed, 09 Feb 2022 10:01:38 GMT

This is still in the early analysis phase and will be built for Qlik Sense SaaS, pending the analysis and subsequent architecture investigations will provide a clearer indication of its applicability for Qlik Sense Client Managed

Ian

Re: Parquet File Connector

AlexOmetis — Wed, 09 Feb 2022 10:04:46 GMT

@Ian_Crosland - that's what I assumed, thanks for confirming so quickly!

Re: Parquet File Connector

mehmet_gencsoy — Tue, 15 Feb 2022 08:48:13 GMT

@Ian_Crosland

Hi Ian,

we need it for QS Client Managed.

Thanks.

Mehmet

Re: Parquet File Connector

dvasseur — Wed, 04 May 2022 10:03:56 GMT

FYI, we had the same issue for one of our customers (load parquet files from azure) so I developed a connector for this. It's beta/unfinished/missing options (no preview, load all columns, ...) and quite slow but it's doing the job, customer is happy :). Here is a sample script:

// link to azure blob storage with parquet files

lib connect to 'datalake azure';

// load all parquet files from dataiku/RCU/CUSTOMER/ in dataiku container

select * from dataiku.dataiku/RCU/CUSTOMER/;

As I said, it's quick and dirty, I'll be very happy to replace it with Qlik's one, once published, but for now...

If needed, I could share it (authentication to azure based on shared key only, shared access signature not supported)

Re: Parquet File Connector

korsikov — Wed, 15 Jun 2022 13:54:58 GMT

Hi all.

Is there any news when will be released connector s3 parquet for qse CM and QSE saas?

Re: Parquet File Connector

GuilhermeSchneider — Wed, 29 Jun 2022 11:47:54 GMT

Hello,

Any news about that parquet file connector?

Re: Parquet File Connector

Ian_Crosland — Thu, 30 Jun 2022 08:05:52 GMT

This is still in a planned state, no current ETA as the team involved working on other priority items, i will post an ETA once we get onto the next stage, currently alternatives are available via 3rd party layers and ODBC e.g. impala/Athena

Thanks

Ian

Re: Parquet File Connector

FilipWuebbeler — Wed, 04 Jan 2023 10:18:41 GMT

Hi @Ian_Crosland - do you have an update on ETA for the parquet file connector for both CME and QSE SaaS that you could share, please?

Re: Parquet File Connector

Ian_Crosland — Wed, 04 Jan 2023 13:29:35 GMT

Hi @FilipWuebbeler

We are planning a customer EAP in February on SaaS and the results of this will dictate the GA dates for both CME and QSE SaaS.

If you have any interest in participating in the EAP please contact steven.pressland@qlik.com

Thanks

Ian