Thomas Graves 23385e853e [SPARK-13054] Always post TaskEnd event for tasks ... I am using dynamic container allocation and speculation and am seeing issues with the active task accounting. The Executor UI still shows active tasks on the an executor but the job/stage is all completed. I think its also affecting the dynamic allocation being able to release containers because it thinks there are still tasks. There are multiple issues with this: - If the task end for tasks (in this case probably because of speculation) comes in after the stage is finished, then the DAGScheduler.handleTaskCompletion will skip the task completion event Author: Thomas Graves <tgraves@prevailsail.corp.gq1.yahoo.com> Author: Thomas Graves <tgraves@staydecay.corp.gq1.yahoo.com> Author: Tom Graves <tgraves@yahoo-inc.com> Closes #10951 from tgravescs/SPARK-11701.		2016-03-14 12:31:46 -07:00
..
src	[SPARK-13054] Always post TaskEnd event for tasks	2016-03-14 12:31:46 -07:00
pom.xml	[SPARK-13848][SPARK-5185] Update to Py4J 0.9.2 in order to fix classloading issue	2016-03-14 12:22:02 -07:00