spark-instrumented-optimizer/resource-managers/kubernetes
gschiavon a09747bf32 [SPARK-33063][K8S] Improve error message for insufficient K8s volume confs
### What changes were proposed in this pull request?
Provide error handling when creating kubernetes volumes. Right now they keys are expected to be there and if not it fails with a `key not found` error, but not knowing why do you need that `key`.

Also I renamed some tests that didn't indicate the kind of kubernetes volume

### Why are the changes needed?

Easier for the users to understand why `spark-submit` command is failing if not providing they right kubernetes volumes properties.

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
It was tested with the current tests plus added one more.

[Jira ticket](https://issues.apache.org/jira/browse/SPARK-33063)

Closes #29941 from Gschiavon/SPARK-33063-provide-error-handling-k8s-volumes.

Authored-by: gschiavon <germanschiavon@gmail.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
2020-10-05 09:02:06 -07:00
..
core [SPARK-33063][K8S] Improve error message for insufficient K8s volume confs 2020-10-05 09:02:06 -07:00
docker/src/main/dockerfiles/spark [SPARK-32882][K8S] Remove python2 installation in K8s python image 2020-09-14 16:03:19 -07:00
integration-tests [SPARK-33012][BUILD][K8S] Upgrade fabric8 to 4.10.3 2020-09-30 19:00:18 -07:00