spark-instrumented-optimizer/resource-managers/kubernetes
Kent Yao 96b0548ab6 [SPARK-35493][K8S] make spark.blockManager.port fallback for spark.driver.blockManager.port as same as other cluster managers
### What changes were proposed in this pull request?

`spark.blockManager.port` does not work for k8s driver pods now, we should make it work as other cluster managers.

### Why are the changes needed?

`spark.blockManager.port` should be able to work for spark driver pod

### Does this PR introduce _any_ user-facing change?

yes, `spark.blockManager.port` will be respect iff it is present  && `spark.driver.blockManager.port` is absent

### How was this patch tested?

new tests

Closes #32639 from yaooqinn/SPARK-35493.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
2021-05-23 08:07:57 -07:00
..
core [SPARK-35493][K8S] make spark.blockManager.port fallback for spark.driver.blockManager.port as same as other cluster managers 2021-05-23 08:07:57 -07:00
docker/src/main/dockerfiles/spark [SPARK-34820][K8S][R] add apt-update before gnupg install 2021-03-22 10:13:31 -07:00
integration-tests [SPARK-35394][K8S][BUILD] Move kubernetes-client.version to root pom file 2021-05-13 00:40:53 -07:00