spark-instrumented-optimizer/common/network-common/src
Jose Luis Pedrosa 0671395966 [SPARK-27989][CORE] Added retries on the connection to the driver for k8s
Disabled negative dns caching for docker images

Improved logging on DNS resolution, convenient for slow k8s clusters

## What changes were proposed in this pull request?
Added retries when building the connection to the driver in K8s.
In some scenarios DNS reslution can take more than the timeout.
Also openjdk-8 by default has negative dns caching enabled, which means even retries may not help depending on the times.

## How was this patch tested?
This patch was tested agains an specific k8s cluster with slow response time in DNS to ensure it woks.

Closes #24702 from jlpedrosa/feature/kuberetries.

Authored-by: Jose Luis Pedrosa <jlpedrosa@gmail.com>
Signed-off-by: Sean Owen <sean.owen@databricks.com>
2019-06-24 09:25:43 -05:00
..
main/java/org/apache/spark/network [SPARK-27989][CORE] Added retries on the connection to the driver for k8s 2019-06-24 09:25:43 -05:00
test [SPARK-27677][CORE] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation 2019-05-23 13:15:39 -07:00