77cd133e96
### What changes were proposed in this pull request? Don't open watch when not needed ### Why are the changes needed? In spark-submit, we currently open a pod watch for any spark submission. If WAIT_FOR_APP_COMPLETION is false, we then immediately ignore the result of the watcher and break out of the watcher. When submitting spark applications at scale, this is a source of operational pain, since opening the watch relies on opening a websocket, which tends to run into subtle networking issues around negotiating the websocket connection. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Standard tests Closes #34095 from slothspot/spark-35174. Authored-by: Dmytro Melnychenko <dmytro.i.am@gmail.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org> |
||
---|---|---|
.. | ||
core | ||
docker/src/main/dockerfiles/spark | ||
integration-tests |