From 3edab6cc1d70c102093e973a2cf97208db19be8c Mon Sep 17 00:00:00 2001 From: Kent Yao Date: Wed, 4 Mar 2020 20:37:51 -0800 Subject: [PATCH] [MINOR][CORE] Expose the alias -c flag of --conf for spark-submit ### What changes were proposed in this pull request? -c is short for --conf, it was introduced since v1.1.0 but hidden from users until now ### Why are the changes needed? ### Does this PR introduce any user-facing change? no expose hidden feature ### How was this patch tested? Nah Closes #27802 from yaooqinn/conf. Authored-by: Kent Yao Signed-off-by: Dongjoon Hyun --- .../scala/org/apache/spark/deploy/SparkSubmitArguments.scala | 2 +- docs/configuration.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala index 3f7cfea778..3090a3b10a 100644 --- a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala +++ b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala @@ -513,7 +513,7 @@ private[deploy] class SparkSubmitArguments(args: Seq[String], env: Map[String, S | directory of each executor. File paths of these files | in executors can be accessed via SparkFiles.get(fileName). | - | --conf PROP=VALUE Arbitrary Spark configuration property. + | --conf, -c PROP=VALUE Arbitrary Spark configuration property. | --properties-file FILE Path to a file from which to load extra properties. If not | specified, this will look for conf/spark-defaults.conf. | diff --git a/docs/configuration.md b/docs/configuration.md index a13ec00954..8106d9364d 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -95,7 +95,7 @@ Then, you can supply configuration values at runtime: The Spark shell and [`spark-submit`](submitting-applications.html) tool support two ways to load configurations dynamically. The first is command line options, -such as `--master`, as shown above. `spark-submit` can accept any Spark property using the `--conf` +such as `--master`, as shown above. `spark-submit` can accept any Spark property using the `--conf/-c` flag, but uses special flags for properties that play a part in launching the Spark application. Running `./bin/spark-submit --help` will show the entire list of these options.