ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

Update documentation for externalSorting

Browse source
This commit is contained in:
Andrew Or 2014-01-10 15:45:38 -08:00
parent e4c51d2113
commit 2e393cd5fd
1 changed files with 2 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
docs/configuration.md
View file

@ -391,9 +391,8 @@ Apart from these, the following properties are also available, and may be useful
<td>spark.shuffle.externalSorting</td>
<td>true</td>
<td>
If set to "true", spills in-memory maps used for shuffles to disk when a memory threshold is reached. This
threshold is specified by <code>spark.shuffle.memoryFraction</code>. Enable this especially for memory-intensive
applications.
If set to "true", limits the amount of memory used during reduces by spilling data out to disk. This spilling
threshold is specified by <code>spark.shuffle.memoryFraction</code>.
</td>
</tr>
<tr>