Skip to main content

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
This page is no longer in use. To suggest an idea, please visit Browse and Suggest.

Support Avro and Parquet file format in File target endpoint in Replicate

Prabodh
Creator II
Creator II

Support Avro and Parquet file format in File target endpoint in Replicate

We would like to use File target endpoint to populate our datalake using Replicate. However, our datalake file format is Avro which is not currently supported by Replicate.

 

Please add support for Avro and Parquet file formats in File target endpoint.

5 Comments
simonaubert
Partner - Specialist II
Partner - Specialist II

Hello@Prabodh 

 

May be a stupid question, but why don't you use Orc instead of Avro?

It's fastest and has better compression. Also, it works great with hive or druid.

 

Best regards,

Simon

Shelley_Brennan
Former Employee
Former Employee

Thank you for the feedback.  Do you have any more details on your use case and if you've considered using Qlik Compose to build out the data lake, which does support Avro and Parquet file formats?

Status changed to: Open - Collecting Feedback
Prabodh
Creator II
Creator II

@simonaubert Avro is our standard data lake format.

 

@Shelley_Brennan Compose would not work for us. We need Replicate to land files in Avro format. Also, to be specific, we need the capability to write Avro files for S3 endpoint on priority.

Shelley_Brennan
Former Employee
Former Employee

Support for additional file formats is in our roadmap.  We will update when development is underway.  Please continue to share any additional feedback here in the meantime.  Thank you!

Status changed to: Open - On Roadmap
Nulee_Massaro
Employee
Employee

Partially delivered - The option to create files in Parquet format has been added to the Amazon S3 target endpoint. 

Status changed to: Partially Delivered