We request to add a new option to the file format under the file attributes in ADLS Gen2 Endpoint as the current two options (CSV / JSON) are not sufficient for our organization.
We are facing multiple issues with tables that have special characters and using CSV format as delimiter are not segregating the data properly.
And for both option, we see that the file size grows tremendously.
Parquet format supporting would bring tremendous value to our DI process.
Hi - We currently have plans to support this in the near future (I will update once I have a batter idea of timing). We are soon (in a couple of weeks) releasing Parquet file support for S3 and will follow that up with ADLS.
We are also looking forward for support of Parquet Format for ADLS gen2 Endpoint. Can you please give us a date from when it will be available? And does it require Replicate application version upgrade?
No ETA yet, we are wrapping up the Tech Preview of Parquet on S#, and any feedback from that will be completed and then work on certifying ADLS will happen. This is a high priority item for us as I mentioned and we will hopefully have something to show soon after the May release.
Jira issue : RECOB-5686 Salesforce case : N/A Type : Enhancement Component/Process: Microsoft Azure ADLS and Google Cloud Storage Targets Description : Added Parquet file format support.
Since this is considered early access, you can contact your Qlik Account team...or wait a couple of weeks when this is a GA Service release and it will be available via normal channels.
