Please enlighten me regarding the spark configuration for setting Max executors.
Does parameterizing max executors property and setting a specific value to it provides optimum usage of resources on hadoop server for big data job? if it is, doesn't resource manager dynamically allocates executors just as required for the specific job?
Please let me know the scenarios where both the cases are applicable.
