spark-instrumented-optimizer/resource-managers
Gene Pang 4329eb2e73 [SPARK-16944][Mesos] Improve data locality when launching new executors when dynamic allocation is enabled
## What changes were proposed in this pull request?

Improve the Spark-Mesos coarse-grained scheduler to consider the preferred locations when dynamic allocation is enabled.

## How was this patch tested?

Added a unittest, and performed manual testing on AWS.

Author: Gene Pang <gene.pang@gmail.com>

Closes #18098 from gpang/mesos_data_locality.
2017-10-02 15:09:11 -07:00
..
mesos [SPARK-16944][Mesos] Improve data locality when launching new executors when dynamic allocation is enabled 2017-10-02 15:09:11 -07:00
yarn [SPARK-21384][YARN] Spark + YARN fails with LocalFileSystem as default FS 2017-09-20 16:22:36 -07:00