0869b3a5f0
## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Mesos agents by default will not pull docker images which are cached locally already. In order to run Spark executors from mutable tags like `:latest` this commit introduces a Spark setting (`spark.mesos.executor.docker.forcePullImage`). Setting this flag to true will tell the Mesos agent to force pull the docker image (default is `false` which is consistent with the previous implementation and Mesos' default behaviour). Author: Philipp Hoffmann <mail@philipphoffmann.de> Closes #14348 from philipphoffmann/force-pull-image.
24 lines
616 B
YAML
24 lines
616 B
YAML
highlighter: pygments
|
|
markdown: kramdown
|
|
gems:
|
|
- jekyll-redirect-from
|
|
|
|
# For some reason kramdown seems to behave differently on different
|
|
# OS/packages wrt encoding. So we hard code this config.
|
|
kramdown:
|
|
entity_output: numeric
|
|
|
|
include:
|
|
- _static
|
|
- _modules
|
|
|
|
# These allow the documentation to be updated with newer releases
|
|
# of Spark, Scala, and Mesos.
|
|
SPARK_VERSION: 2.1.0-SNAPSHOT
|
|
SPARK_VERSION_SHORT: 2.1.0
|
|
SCALA_BINARY_VERSION: "2.11"
|
|
SCALA_VERSION: "2.11.7"
|
|
MESOS_VERSION: 0.22.0
|
|
SPARK_ISSUE_TRACKER_URL: https://issues.apache.org/jira/browse/SPARK
|
|
SPARK_GITHUB_URL: https://github.com/apache/spark
|