Skip to main content

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Woohoo! Qlik Community has won “Best in Class Community” in the 2024 Khoros Kudos awards!
Announcements
This page is no longer in use. To suggest an idea, please visit Browse and Suggest.

Parquet Format for ADLS gen2 Endpoint

zhangsq24
Contributor II
Contributor II

Parquet Format for ADLS gen2 Endpoint

Hello Team,

We request to add a new option to the file format under the file attributes in ADLS Gen2 Endpoint as the current two options (CSV / JSON) are not sufficient for our organization.

We are facing multiple issues with tables that have special characters and using CSV format as delimiter are not segregating the data properly. 

And for both option, we see that the file size grows tremendously.

Parquet format supporting would bring tremendous value to our DI process.

Thank you!

Tags (1)
13 Comments
bobvecchione
Employee
Employee

Hi - We currently have plans to support this in the near future (I will update once I have a batter idea of timing). We are soon (in a couple of weeks) releasing Parquet file support for S3 and will follow that up with ADLS.

Bob V

 

zhangsq24
Contributor II
Contributor II

Thanks, if there is a pre-testing, please let us join beta test.

 

Bhargav_Ranjit
Contributor
Contributor

Hi guys,

We are also looking forward for support of Parquet Format for ADLS gen2 Endpoint. Can you please give us a date from when it will be available? And does it require Replicate application version upgrade? 

Cheers,

Bhargav. 

Bhargav_Ranjit
Contributor
Contributor

Any updates on when we can expect parquet support with ADLS? 

It's more than a month since my last follow up 🙂 

bobvecchione
Employee
Employee

No ETA yet, we are wrapping up the Tech Preview of Parquet on S#, and any feedback from that will be completed and then work on certifying ADLS will happen. This is a high priority item for us as I mentioned and we will hopefully have something to show soon after the May release.

 

Bob V

Evan_Hodge_IBT
Partner - Contributor II
Partner - Contributor II

Is Parquet on ADLS likely to make it into the Nov 2022 Release?

john_wang
Support
Support

@Evan_Hodge_IBT ,

Yes, it's added in SP02 already:

 

Qlik Replicate May 2022 – Patch Release Notes (PR02 - build 2022.5.499)

Jira issue : RECOB-5686
Salesforce case : N/A
Type : Enhancement
Component/Process: Microsoft Azure ADLS and Google Cloud Storage Targets
Description : Added Parquet file format support.

 

Hope this helps.

John.

bobvecchione
Employee
Employee

Thanks John...To be clear this was added as a (Patch Release) along with a few other new capabilities 2 weeks ago.

 

I hope this helps!

 

--bobv--

Bhargav_Ranjit
Contributor
Contributor

Hi Team,

Can you please share the installable download link? 

bobvecchione
Employee
Employee

Since this is considered early access, you can contact your Qlik Account team...or wait a couple of weeks when this is a GA Service release and it will be available via normal channels.

 

Thanks

 

--bobv--