182727d90f
### What changes were proposed in this pull request? This PR aims to support executor id placeholder in `spark.kubernetes.executor.volumes.persistentVolumeClaim.myname.options.claimName` configuration like the following. ``` --conf spark.kubernetes.executor.volumes.persistentVolumeClaim.spark-local-dir-1.options.claimName=pvc-spark-SPARK_EXECUTOR_ID \ ``` ### Why are the changes needed? This is a convenient way to mount corresponding PV to the executor. ### Does this PR introduce _any_ user-facing change? Yes, but this is a new feature and there is no regression because users don't use `SPARK_EXECUTOR_ID` in PVC claim name. ### How was this patch tested? Pass the newly added test case. Closes #29557 from dongjoon-hyun/SPARK-PVC. Authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org> |
||
|---|---|---|
| .. | ||
| kubernetes | ||
| mesos | ||
| yarn | ||