parquet table error

[mshafeeq]

hello ALl,

i'm facing this error while run job to insert data into parquet file format

org.apache.hive.service.cli.HiveSQLException: Error while processing statement: Cannot modify parquet.compression at runtime. It is not in list of params that are allowed to be modified at runtime

[Anonymous]

Hello,

By default, the HDP cluster has been configured to set these values as "final" and not modifiable by a job, but a cluster administrator can change them to non-final. This can depend on many factors, such as their network configuration, their security policies, etc. 

In this case as you can see in the error you are getting the cluster is thinking that the job is trying to modify a parameter hence the error you were getting.

Could you please post your job design here? Is it a hive job? Are you trying to pass that parameter(parquet.compression) within the hive job?

Best regards

Sabrina

[mshafeeq]

@Xiaodi Shi​  hello ,

this is the job design , put file from local directory to hdfs and create table parquet and insert data from file to this table

[Anonymous]

Hello,

My recommendation will be in the thivecreatetable component that you are using to uncheck the resource manager checkbox, the scheduler and also the namenode checkbox and that should make that error go away.

Also check and see if you are passing that property through hadoop properties.

Feel free to let us know if it helps.

Best regards

Sabrina