AC4DL - How to configure a Compose Spark task to write an uncompressed Parquet file?

[David_Fergen]

Question:

How to configure a Compose Spark task to write an uncompressed Parquet file?

Answer:

The default settings will output compressed parquest files, to set the output to uncompressed, perform the followings:

1. Open the Storage job settings and click on the Spark tab.
2. In the Spark Parameters section, add the following parameter:

spark.sql.parquet.compression.codec=uncompressed;