spark-instrumented-optimizer/resource-managers/kubernetes
Holden Karau 1c7f5f1ac7
[SPARK-33724][K8S] Add decom script as a configuration param
### What changes were proposed in this pull request?

Makes the location of the decommission script used in Kubernetes for graceful shutdown configurable.

### Why are the changes needed?

Some environments don't use the Spark image builder and instead mount the decompressed Spark distro. In those envs configuring the location of the decommissioning script is required.

### Does this PR introduce _any_ user-facing change?

New configuration parameter.

### How was this patch tested?

Existing decommissioning integration test.

Closes #30694 from holdenk/SPARK-33724-allow-decommissioning-script-location-to-be-configured.

Authored-by: Holden Karau <hkarau@apple.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
2020-12-09 20:42:10 -08:00
..
core [SPARK-33724][K8S] Add decom script as a configuration param 2020-12-09 20:42:10 -08:00
docker/src/main/dockerfiles/spark [SPARK-33727][K8S] Fall back from gnupg.net to openpgp.org 2020-12-10 11:35:55 +09:00
integration-tests [SPARK-33668][K8S][TEST] Fix flaky test "Verify logging configuration is picked from the provided 2020-12-05 23:04:55 -08:00