spark-instrumented-optimizer/resource-managers
Pedro Rossi ed06d98044
[SPARK-25355][K8S] Add proxy user to driver if present on spark-submit
### What changes were proposed in this pull request?

This PR adds the proxy user on the spark-submit command to the childArgs, so the proxy user can be retrieved and used in the KubernetesAplication to add the proxy user in the driver container args

### Why are the changes needed?

The proxy user when used on the spark submit doesn't work on the Kubernetes environment since it doesn't add the `--proxy-user` argument on the driver container and when I added it manually to the Pod definition it worked just fine.

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

Tests were added

Closes #27422 from PedroRossi/SPARK-25355.

Authored-by: Pedro Rossi <pgrr@cin.ufpe.br>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
2020-03-16 21:53:58 -07:00
..
kubernetes [SPARK-25355][K8S] Add proxy user to driver if present on spark-submit 2020-03-16 21:53:58 -07:00
mesos [SPARK-30654][WEBUI] Bootstrap4 WebUI upgrade 2020-03-13 15:24:48 -07:00
yarn [SPARK-31092][YARN][DOC] Add version information to the configuration of Yarn 2020-03-12 09:52:57 +09:00