spark-instrumented-optimizer/resource-managers/kubernetes/docker/src/main/dockerfiles/spark
Holden Karau ff3f3c4566 [SPARK-36058][K8S] Add support for statefulset APIs in K8s
### What changes were proposed in this pull request?

Generalize the pod allocator and add support for statefulsets.

### Why are the changes needed?

Allocating individual pods in Spark can be not ideal for some clusters and using higher level operators like statefulsets and replicasets can be useful.

### Does this PR introduce _any_ user-facing change?

Yes new config options.

### How was this patch tested?

Completed: New unit & basic integration test
PV integration tests

Closes #33508 from holdenk/SPARK-36058-support-replicasets-or-job-api-like-things.

Lead-authored-by: Holden Karau <hkarau@netflix.com>
Co-authored-by: Holden Karau <holden@pigscanfly.ca>
Signed-off-by: Holden Karau <hkarau@netflix.com>
2021-08-25 17:38:57 -07:00
..
bindings [SPARK-35885][K8S][R] Use keyserver.ubuntu.com as a keyserver for CRAN 2021-06-24 19:51:49 -07:00
decom.sh [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling 2020-08-12 17:07:18 -07:00
Dockerfile [SPARK-33176][K8S] Use 11-jre-slim as default in K8s Dockerfile 2020-10-18 09:21:07 -07:00
entrypoint.sh [SPARK-36058][K8S] Add support for statefulset APIs in K8s 2021-08-25 17:38:57 -07:00