86c42275ba
### What changes were proposed in this pull request? This PR aims to add a new config to allow K8s API server-side caching for pod listing. ### Why are the changes needed? Apache Spark currently requests the most recent data which should be consistent. New configuration looses the restriction to reduce the server-side overhead by allowing K8S API server side caching. https://kubernetes.io/docs/reference/using-api/api-concepts/#the-resourceversion-parameter - `resourceVersion`: unset > Most Recent: Return data at the most recent resource version. The returned data must be consistent (i.e. served from etcd via a quorum read). - `resourceVersion`: "0" > Any: Return data at any resource version. The newest available resource version is preferred, but strong consistency is not required; data at any resource version may be served. ### Does this PR introduce _any_ user-facing change? Yes, this is a new feature to reduce the K8s API server side overhead. ### How was this patch tested? Pass the CIs. Closes #33563 from dongjoon-hyun/SPARK-36334. Authored-by: Dongjoon Hyun <dhyun@apple.com> Signed-off-by: Dongjoon Hyun <dhyun@apple.com> |
||
|---|---|---|
| .. | ||
| kubernetes | ||
| mesos | ||
| yarn | ||