ff3f3c4566
### What changes were proposed in this pull request? Generalize the pod allocator and add support for statefulsets. ### Why are the changes needed? Allocating individual pods in Spark can be not ideal for some clusters and using higher level operators like statefulsets and replicasets can be useful. ### Does this PR introduce _any_ user-facing change? Yes new config options. ### How was this patch tested? Completed: New unit & basic integration test PV integration tests Closes #33508 from holdenk/SPARK-36058-support-replicasets-or-job-api-like-things. Lead-authored-by: Holden Karau <hkarau@netflix.com> Co-authored-by: Holden Karau <holden@pigscanfly.ca> Signed-off-by: Holden Karau <hkarau@netflix.com> |
||
|---|---|---|
| .. | ||
| java/org/apache/spark/examples | ||
| python | ||
| r | ||
| resources | ||
| scala/org/apache/spark/examples | ||
| scripts | ||