spark-instrumented-optimizer/core
Lianhui Wang 4f369176b7 [SPARK-4452] [CORE] Shuffle data structures can starve others on the same thread for memory
## What changes were proposed in this pull request?
In #9241 It implemented a mechanism to call spill() on those SQL operators that support spilling if there is not enough memory for execution.
But ExternalSorter and AppendOnlyMap in Spark core are not worked. So this PR make them benefit from #9241. Now when there is not enough memory for execution, it can get memory by spilling ExternalSorter and AppendOnlyMap in Spark core.

## How was this patch tested?
add two unit tests for it.

Author: Lianhui Wang <lianhuiwang09@gmail.com>

Closes #10024 from lianhuiwang/SPARK-4452-2.
2016-04-21 10:02:23 -07:00
..
src [SPARK-4452] [CORE] Shuffle data structures can starve others on the same thread for memory 2016-04-21 10:02:23 -07:00
pom.xml [SPARK-14612][ML] Consolidate the version of dependencies in mllib and mllib-local into one place 2016-04-14 10:48:17 -07:00