ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

SPARK-6085 Part. 2 Increase default value for memory overhead

Browse source 
- fixed a description of spark.mesos.executor.memoryOverhead from 7% to 10%
- This is a second part of SPARK-6085

Author: Jongyoul Lee <jongyoul@gmail.com>

Closes #5065 from jongyoul/SPARK-6085-1 and squashes the following commits:

c5af84c [Jongyoul Lee] SPARK-6085 Part. 2 Increase default value for memory overhead - Changed "MiB" to "MB"
dbac1c0 [Jongyoul Lee] SPARK-6085 Part. 2 Increase default value for memory overhead - fixed a description of spark.mesos.executor.memoryOverhead from 7% to 10%
This commit is contained in:
Jongyoul Lee 2015-03-18 20:54:22 -04:00 committed by Sean Owen
parent a95ee242b0
commit 3db1387425
1 changed files with 3 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
docs/running-on-mesos.md
View file

@ -224,11 +224,11 @@ See the [configuration page](configuration.html) for information on Spark config
<td><code>spark.mesos.executor.memoryOverhead</code></td>
<td>executor memory * 0.10, with minimum of 384</td>
<td>
This value is an additive for <code>spark.executor.memory</code>, specified in MiB,
This value is an additive for <code>spark.executor.memory</code>, specified in MB,
which is used to calculate the total Mesos task memory. A value of <code>384</code>
implies a 384MiB overhead. Additionally, there is a hard-coded 7% minimum
implies a 384MB overhead. Additionally, there is a hard-coded 10% minimum
overhead. The final overhead will be the larger of either
`spark.mesos.executor.memoryOverhead` or 7% of `spark.executor.memory`.
`spark.mesos.executor.memoryOverhead` or 10% of `spark.executor.memory`.
</td>
</tr>
</table>