From eea69c122f20577956c4a87a6d8eb59943c1c6f0 Mon Sep 17 00:00:00 2001 From: yoda-mon Date: Sun, 18 Jul 2021 14:26:15 -0700 Subject: [PATCH] [SPARK-36040][DOCS][K8S] Add reference to kubernetes-client's version ### What changes were proposed in this pull request? Add reference to kubernetes-client's version ### Why are the changes needed? Running Spark on Kubernetes potentially has upper limitation of Kubernetes version. I think it is better for users to notice it because Kubernetes update speed is so fast that users tends to run Spark Jobs on unsupported version. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? SKIP_API=1 bundle exec jekyll build Closes #33255 from yoda-mon/add-reference-kubernetes-client. Authored-by: yoda-mon Signed-off-by: Dongjoon Hyun --- docs/running-on-kubernetes.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md index 530951e839..6ca3375f4f 100644 --- a/docs/running-on-kubernetes.md +++ b/docs/running-on-kubernetes.md @@ -53,6 +53,7 @@ you may set up a test cluster on your local machine using * Be aware that the default minikube configuration is not enough for running Spark applications. We recommend 3 CPUs and 4g of memory to be able to start a simple Spark application with a single executor. + * Check [kubernetes-client library](https://github.com/fabric8io/kubernetes-client)'s version of your Spark environment, and its compatibility with your Kubernetes cluster's version. * You must have appropriate permissions to list, create, edit and delete [pods](https://kubernetes.io/docs/user-guide/pods/) in your cluster. You can verify that you can list these resources by running `kubectl auth can-i pods`.