attilapiros eb09be9e68 [SPARK-36052][K8S] Introducing a limit for pending PODs ... Introducing a limit for pending PODs (newly created/requested executors included). This limit is global for all the resource profiles. So first we have to count all the newly created and pending PODs (decreased by the ones which requested to be deleted) then we can share the remaining pending POD slots among the resource profiles. Without this PR dynamic allocation could request too many PODs and the K8S scheduler could be overloaded and scheduling of PODs will be affected by the load. No. With new unit tests. Closes #33492 from attilapiros/SPARK-36052. Authored-by: attilapiros <piros.attila.zsolt@gmail.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org> (cherry picked from commit 1dced492fb) Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>		2021-08-16 16:06:29 -07:00
..
src	[SPARK-36052][K8S] Introducing a limit for pending PODs	2021-08-16 16:06:29 -07:00
pom.xml	[SPARK-35394][K8S][BUILD] Move kubernetes-client.version to root pom file	2021-05-13 00:40:53 -07:00