spark-instrumented-optimizer/core/src/main
Andrew Or e0110792ef [SPARK-9747] [SQL] Avoid starving an unsafe operator in aggregation
This is the sister patch to #8011, but for aggregation.

In a nutshell: create the `TungstenAggregationIterator` before computing the parent partition. Internally this creates a `BytesToBytesMap` which acquires a page in the constructor as of this patch. This ensures that the aggregation operator is not starved since we reserve at least 1 page in advance.

rxin yhuai

Author: Andrew Or <andrew@databricks.com>

Closes #8038 from andrewor14/unsafe-starve-memory-agg.
2015-08-12 10:08:35 -07:00
..
java/org/apache/spark [SPARK-9747] [SQL] Avoid starving an unsafe operator in aggregation 2015-08-12 10:08:35 -07:00
resources/org/apache/spark [SPARK-9426] [WEBUI] Job page DAG visualization is not shown 2015-08-11 23:25:02 -07:00
scala/org/apache/spark [SPARK-9795] Dynamic allocation: avoid double counting when killing same executor twice 2015-08-12 09:24:50 -07:00