ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/core/src/main
History
Davies Liu 83de71c45b [SPARK-4939] revive offers periodically in LocalBackend 
The locality timeout assume that the SchedulerBackend can revive offers periodically, but currently LocalBackend did do that, then some job with mixed locality levels in local mode will hang forever.

This PR let LocalBackend revive offers periodically, just like in cluster mode.

Author: Davies Liu <davies@databricks.com>

Closes #4147 from davies/revive and squashes the following commits:

2acdf9d [Davies Liu] Update LocalBackend.scala
3c8ca7c [Davies Liu] Update LocalBackend.scala
d1b60d2 [Davies Liu] address comments from Kay
33ac9bb [Davies Liu] fix build
d0da0d5 [Davies Liu] Merge branch 'master' of github.com:apache/spark into revive
6cf5972 [Davies Liu] fix thread-safety
ed62a31 [Davies Liu] fix scala style
df9008b [Davies Liu] fix typo
bfc1396 [Davies Liu] revive offers periodically in LocalBackend
2015-02-03 22:30:23 -08:00
..
java/org/apache/spark [SPARK-5549] Define TaskContext interface in Scala. 2015-02-03 00:46:04 -08:00
resources/org/apache/spark SPARK-5393. Flood of util.RackResolver log messages after SPARK-1714 2015-01-30 11:31:54 -06:00
scala/org/apache/spark [SPARK-4939] revive offers periodically in LocalBackend 2015-02-03 22:30:23 -08:00