spark-instrumented-optimizer/core
colinma 076186e881 [SPARK-19147][CORE] Gracefully handle error in task after executor is stopped
### What changes were proposed in this pull request?

TransportClientFactory.createClient() is called by task and TransportClientFactory.close() is called by executor.
When stop the executor, close() will set workerGroup = null, NPE will occur in createClient which generate many exception in log.
For exception occurs after close(), treated it as an expected Exception
and transform it to InterruptedException which can be processed by Executor.

### Why are the changes needed?

The change can reduce the exception stack trace in log file, and user won't be confused by these excepted exception.

### Does this PR introduce any user-facing change?

N/A

### How was this patch tested?

New tests are added in TransportClientFactorySuite and ExecutorSuite

Closes #25759 from colinmjj/spark-19147.

Authored-by: colinma <colinma@tencent.com>
Signed-off-by: Sean Owen <sean.owen@databricks.com>
2019-09-21 07:31:39 -05:00
..
benchmarks [SPARK-29192][TESTS] Extend BenchmarkBase to write JDK9+ results separately 2019-09-20 19:41:25 -07:00
src [SPARK-19147][CORE] Gracefully handle error in task after executor is stopped 2019-09-21 07:31:39 -05:00
pom.xml [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3 2019-08-21 21:27:56 -07:00