spark-instrumented-optimizer/resource-managers
xushiwei 00425595 f14061c6a4 [SPARK-30371][K8S] Add spark.kubernetes.driver.master conf
### What changes were proposed in this pull request?

make KUBERNETES_MASTER_INTERNAL_URL configurable

### Why are the changes needed?

we do not always use the default port number 443 to access our kube-apiserver, and even in some mulit-tenant cluster,  people do not use the service `kubernetes.default.svc` to access the kube-apiserver, so make the internal master configurable is necessary。

### Does this PR introduce any user-facing change?

user can configure the internal master url by
```
--conf spark.kubernetes.internal.master=https://kubernetes.default.svc:6443
```

### How was this patch tested?

run in multi-cluster that do not use the https://kubernetes.default.svc to access the kube-apiserver

Closes #27029 from wackxu/internalmaster.

Authored-by: xushiwei 00425595 <xushiwei5@huawei.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
2020-01-19 14:14:45 -08:00
..
kubernetes [SPARK-30371][K8S] Add spark.kubernetes.driver.master conf 2020-01-19 14:14:45 -08:00
mesos [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with 2020-01-17 08:15:25 -06:00
yarn [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with 2020-01-17 08:15:25 -06:00