spark-instrumented-optimizer/project
Lianhui Wang 4f369176b7 [SPARK-4452] [CORE] Shuffle data structures can starve others on the same thread for memory
## What changes were proposed in this pull request?
In #9241 It implemented a mechanism to call spill() on those SQL operators that support spilling if there is not enough memory for execution.
But ExternalSorter and AppendOnlyMap in Spark core are not worked. So this PR make them benefit from #9241. Now when there is not enough memory for execution, it can get memory by spilling ExternalSorter and AppendOnlyMap in Spark core.

## How was this patch tested?
add two unit tests for it.

Author: Lianhui Wang <lianhuiwang09@gmail.com>

Closes #10024 from lianhuiwang/SPARK-4452-2.
2016-04-21 10:02:23 -07:00
..
project [MINOR][BUILD] Changed the comment to reflect the plugin project is there to support SBT pom reader only. 2015-11-30 09:30:58 +00:00
build.properties [SPARK-13834][BUILD] Update sbt and sbt plugins for 2.x. 2016-03-13 18:47:04 -07:00
MimaBuild.scala [SPARK-13874][DOC] Remove docs of streaming-akka, streaming-zeromq, streaming-mqtt and streaming-twitter 2016-03-26 01:47:27 -07:00
MimaExcludes.scala [SPARK-4452] [CORE] Shuffle data structures can starve others on the same thread for memory 2016-04-21 10:02:23 -07:00
plugins.sbt [SPARK-14683][DOCUMENTATION] Configure external links in ScalaDoc 2016-04-16 11:44:12 -07:00
SparkBuild.scala [SPARK-14504][SQL] Enable Oracle docker tests 2016-04-18 14:35:10 -07:00