SPARK-6085 Part. 2 Increase default value for memory overhead
- fixed a description of spark.mesos.executor.memoryOverhead from 7% to 10% - This is a second part of SPARK-6085 Author: Jongyoul Lee <jongyoul@gmail.com> Closes #5065 from jongyoul/SPARK-6085-1 and squashes the following commits: c5af84c [Jongyoul Lee] SPARK-6085 Part. 2 Increase default value for memory overhead - Changed "MiB" to "MB" dbac1c0 [Jongyoul Lee] SPARK-6085 Part. 2 Increase default value for memory overhead - fixed a description of spark.mesos.executor.memoryOverhead from 7% to 10%
This commit is contained in:
parent
a95ee242b0
commit
3db1387425
|
@ -224,11 +224,11 @@ See the [configuration page](configuration.html) for information on Spark config
|
|||
<td><code>spark.mesos.executor.memoryOverhead</code></td>
|
||||
<td>executor memory * 0.10, with minimum of 384</td>
|
||||
<td>
|
||||
This value is an additive for <code>spark.executor.memory</code>, specified in MiB,
|
||||
This value is an additive for <code>spark.executor.memory</code>, specified in MB,
|
||||
which is used to calculate the total Mesos task memory. A value of <code>384</code>
|
||||
implies a 384MiB overhead. Additionally, there is a hard-coded 7% minimum
|
||||
implies a 384MB overhead. Additionally, there is a hard-coded 10% minimum
|
||||
overhead. The final overhead will be the larger of either
|
||||
`spark.mesos.executor.memoryOverhead` or 7% of `spark.executor.memory`.
|
||||
`spark.mesos.executor.memoryOverhead` or 10% of `spark.executor.memory`.
|
||||
</td>
|
||||
</tr>
|
||||
</table>
|
||||
|
|
Loading…
Reference in a new issue