topic Re: Arbitrary spark submit options (--queue) in Talend Studio

Arbitrary spark submit options (--queue)

derekmcechern — Sat, 16 Nov 2024 02:41:08 GMT

Trying to configure a Big Data job and can't figure out where to specify additional arguments that we currently specify during the spark-submit.

Specifically we use the option --queue where we specify the defined resource queue where we want to job to run.

Where do you specify this option in Talend?

manodwhb — Wed, 15 Apr 2020 05:38:58 GMT

@derekmcechern , You can specify in run tab>>Spark configuration>>advanced properties.

derekmcechern — Wed, 15 Apr 2020 16:33:57 GMT

Thanks for the reply. I've tried this already and it didn't make a difference.