5692aa0c2c
### What changes were proposed in this pull request? Currently, when a connection for TransportClient is marked as idled and closed, we suggest users adjust `spark.network.timeout` for all transport modules. As a lot of timeout configs will fallback to the `spark.network.timeout`, this could be a piece of overkill advice, we should give a more targeted one with `spark.${moduleName}.io.connectionTimeout` ### Why are the changes needed? better advise for overloaded network traffic cases ### Does this PR introduce _any_ user-facing change? yes, when a connection is zombied and closed by spark internally, users can use a more targeted config to tune their jobs ### How was this patch tested? Just log and doc. Passing Jenkins and GA Closes #31990 from yaooqinn/SPARK-34894. Authored-by: Kent Yao <yao@apache.org> Signed-off-by: Kent Yao <yao@apache.org> |
||
---|---|---|
.. | ||
kvstore | ||
network-common | ||
network-shuffle | ||
network-yarn | ||
sketch | ||
tags | ||
unsafe |