spark-instrumented-optimizer/core/src
hushan[胡珊] b78c65b03a [SPARK-5259] [CORE] don't submit stage until its dependencies map outputs are registered
Track pending tasks by partition ID instead of Task objects.

Before this change, failure & retry could result in a case where a stage got submitted before the map output from its dependencies get registered.  This was due to an error in the condition for registering map outputs.

Author: hushan[胡珊] <hushan@xiaomi.com>
Author: Imran Rashid <irashid@cloudera.com>

Closes #7699 from squito/SPARK-5259.
2015-09-21 14:26:15 -05:00
..
main [SPARK-5259] [CORE] don't submit stage until its dependencies map outputs are registered 2015-09-21 14:26:15 -05:00
test [SPARK-5259] [CORE] don't submit stage until its dependencies map outputs are registered 2015-09-21 14:26:15 -05:00