spark-instrumented-optimizer/resource-managers
mcheah 6282fc64e3 [SPARK-24137][K8S] Mount local directories as empty dir volumes.
## What changes were proposed in this pull request?

Drastically improves performance and won't cause Spark applications to fail because they write too much data to the Docker image's specific file system. The file system's directories that back emptydir volumes are generally larger and more performant.

## How was this patch tested?

Has been in use via the prototype version of Kubernetes support, but lost in the transition to here.

Author: mcheah <mcheah@palantir.com>

Closes #21238 from mccheah/mount-local-dirs.
2018-05-10 11:36:41 -07:00
..
kubernetes [SPARK-24137][K8S] Mount local directories as empty dir volumes. 2018-05-10 11:36:41 -07:00
mesos [SPARK-23941][MESOS] Mesos task failed on specific spark app name 2018-05-01 08:28:21 -07:00
yarn [PYSPARK] Update py4j to version 0.10.7. 2018-05-09 10:47:35 -07:00