spark-instrumented-optimizer/core/src
Li Jin 26e66453de [SPARK-22655][PYSPARK] Throw exception rather than exit silently in PythonRunner when Spark session is stopped
## What changes were proposed in this pull request?

During Spark shutdown, if there are some active tasks, sometimes they will complete with incorrect results. The issue is in PythonRunner where it is returning partial result instead of throwing exception during Spark shutdown.

This patch makes it so that these tasks fail instead of complete with partial results.

## How was this patch tested?

Existing tests.

Author: Li Jin <ice.xelloss@gmail.com>

Closes #19852 from icexelloss/python-runner-shutdown.
2017-12-08 20:44:21 +09:00
..
main [SPARK-22655][PYSPARK] Throw exception rather than exit silently in PythonRunner when Spark session is stopped 2017-12-08 20:44:21 +09:00
test [SPARK-22660][BUILD] Use position() and limit() to fix ambiguity issue in scala-2.12 2017-12-07 10:04:04 -06:00