Qlik Community

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Support Avro and Parquet file format in File target endpoint in Replicate

Prabodh
Creator II
Creator II

Support Avro and Parquet file format in File target endpoint in Replicate

We would like to use File target endpoint to populate our datalake using Replicate. However, our datalake file format is Avro which is not currently supported by Replicate.

 

Please add support for Avro and Parquet file formats in File target endpoint.

4 Comments
simonaubert
Partner
Partner

Hello@Prabodh 

 

May be a stupid question, but why don't you use Orc instead of Avro?

It's fastest and has better compression. Also, it works great with hive or druid.

 

Best regards,

Simon

Shelley_Brennan
Employee
Employee

Thank you for the feedback.  Do you have any more details on your use case and if you've considered using Qlik Compose to build out the data lake, which does support Avro and Parquet file formats?

Status changed to: Open - Collecting Feedback
Prabodh
Creator II
Creator II

@simonaubert Avro is our standard data lake format.

 

@Shelley_Brennan Compose would not work for us. We need Replicate to land files in Avro format. Also, to be specific, we need the capability to write Avro files for S3 endpoint on priority.

Shelley_Brennan
Employee
Employee

Support for additional file formats is in our roadmap.  We will update when development is underway.  Please continue to share any additional feedback here in the meantime.  Thank you!

Status changed to: Open - On Roadmap