f85855c115
### What changes were proposed in this pull request? Add the support for specifiying executor/driver node selector: - spark.kubernetes.driver.node.selector. - spark.kubernetes.executor.node.selector. ### Why are the changes needed? Now we can only use "spark.kubernetes.node.selector" to set lable for executor/driver. Sometimes, we need set executor/driver pods to different selector separately. ### Does this PR introduce _any_ user-facing change? Yes ### How was this patch tested? - KubernetesConfSuite for new added configure - BasicDriverFeatureStepSuite to make sure driver pods node selector set properly - BasicExecutorFeatureStepSuite to make sure excutor pods node selector set properly Closes #33283 from Yikun/SPARK-36075. Authored-by: Yikun Jiang <yikunkero@gmail.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org> |
||
|---|---|---|
| .. | ||
| kubernetes | ||
| mesos | ||
| yarn | ||