ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

[SPARK-15781][DOCUMENTATION] remove deprecated environment variable doc

Browse source 
## What changes were proposed in this pull request?

Like `SPARK_JAVA_OPTS` and `SPARK_CLASSPATH`, we will remove the document for `SPARK_WORKER_INSTANCES` to discourage user not to use them. If they are actually used, SparkConf will show a warning message as before.

## How was this patch tested?

Manually tested.

Author: bomeng <bmeng@us.ibm.com>

Closes #13533 from bomeng/SPARK-15781.
This commit is contained in:
bomeng 2016-06-12 12:58:34 +01:00 committed by Sean Owen
parent 8cc22b0085
commit 3fd3ee038b
1 changed files with 0 additions and 9 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

9
docs/spark-standalone.md
View file

@ -133,15 +133,6 @@ You can optionally configure the cluster further by setting environment variable
<td><code>SPARK_WORKER_WEBUI_PORT</code></td>
<td>Port for the worker web UI (default: 8081).</td>
</tr>
<tr>
<td><code>SPARK_WORKER_INSTANCES</code></td>
<td>
Number of worker instances to run on each machine (default: 1). You can make this more than 1 if
you have have very large machines and would like multiple Spark worker processes. If you do set
this, make sure to also set <code>SPARK_WORKER_CORES</code> explicitly to limit the cores per worker,
or else each worker will try to use all the cores.
</td>
</tr>
<tr>
<td><code>SPARK_WORKER_DIR</code></td>
<td>Directory to run applications in, which will include both logs and scratch space (default: SPARK_HOME/work).</td>