Tejas Patil 1d95fb6785 [SPARK-13793][CORE] PipedRDD doesn't propagate exceptions while reading parent RDD ... ## What changes were proposed in this pull request? PipedRDD creates a child thread to read output of the parent stage and feed it to the pipe process. Used a variable to save the exception thrown in the child thread and then propagating the exception in the main thread if the variable was set. ## How was this patch tested? - Added a unit test - Ran all the existing tests in PipedRDDSuite and they all pass with the change - Tested the patch with a real pipe() job, bounced the executor node which ran the parent stage to simulate a fetch failure and observed that the parent stage was re-ran. Author: Tejas Patil <tejasp@fb.com> Closes #11628 from tejasapatil/pipe_rdd.		2016-03-16 09:58:53 +00:00
..
src	[SPARK-13793][CORE] PipedRDD doesn't propagate exceptions while reading parent RDD	2016-03-16 09:58:53 +00:00
pom.xml	[SPARK-13848][SPARK-5185] Update to Py4J 0.9.2 in order to fix classloading issue	2016-03-14 12:22:02 -07:00