ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/core/src/test
History
Marcelo Vanzin cba826d001 [SPARK-17742][CORE] Handle child process exit in SparkLauncher. 
Currently the launcher handle does not monitor the child spark-submit
process it launches; this means that if the child exits with an error,
the handle's state will never change, and an application will not know
that the application has failed.

This change adds code to monitor the child process, and changes the
handle state appropriately when the child process exits.

Tested with added unit tests.

Author: Marcelo Vanzin <vanzin@cloudera.com>

Closes #18877 from vanzin/SPARK-17742.
2017-08-15 11:26:29 -07:00
..
java [SPARK-17742][CORE] Handle child process exit in SparkLauncher. 2017-08-15 11:26:29 -07:00
resources [SPARK-19937] Collect metrics for remote bytes read to disk during shuffle. 2017-06-22 14:10:51 -07:00
scala/org/apache [SPARK-21563][CORE] Fix race condition when serializing TaskDescriptions and adding jars 2017-08-14 22:48:08 +08:00