Merge pull request #126 from kayousterhout/local_fix
Fixed incorrect log message in local scheduler This change is especially relevant at the moment, because some users are seeing this failure, and the log message is misleading/incorrect (because for the tests, the max failures is set to 0, not 4)
This commit is contained in:
commit
dc9ce16f6b
|
@ -175,7 +175,7 @@ private[spark] class LocalTaskSetManager(sched: LocalScheduler, val taskSet: Tas
|
|||
reason.className, reason.description, locs.mkString("\n")))
|
||||
if (numFailures(index) > MAX_TASK_FAILURES) {
|
||||
val errorMessage = "Task %s:%d failed more than %d times; aborting job %s".format(
|
||||
taskSet.id, index, 4, reason.description)
|
||||
taskSet.id, index, MAX_TASK_FAILURES, reason.description)
|
||||
decreaseRunningTasks(runningTasks)
|
||||
sched.dagScheduler.taskSetFailed(taskSet, errorMessage)
|
||||
// need to delete failed Taskset from schedule queue
|
||||
|
|
Loading…
Reference in a new issue