Brad Kaiser beb717f648 [SPARK-22618][CORE] Catch exception in removeRDD to stop jobs from dying ... ## What changes were proposed in this pull request? I propose that BlockManagerMasterEndpoint.removeRdd() should catch and log any IOExceptions it receives. As it is now, the exception can bubble up to the main thread and kill user applications when called from RDD.unpersist(). I think this change is a better experience for the end user. I chose to catch the exception in BlockManagerMasterEndpoint.removeRdd() instead of RDD.unpersist() because this way the RDD.unpersist() blocking option will still work correctly. Otherwise, blocking will get short circuited by the first error. ## How was this patch tested? This patch was tested with a job that shows the job killing behavior mentioned above. rxin, it looks like you originally wrote this method, I would appreciate it if you took a look. Thanks. This contribution is my original work and is licensed under the project's open source license. Author: Brad Kaiser <kaiserb@us.ibm.com> Closes #19836 from brad-kaiser/catch-unpersist-exception.		2017-12-07 21:04:09 +08:00
..
src	[SPARK-22618][CORE] Catch exception in removeRDD to stop jobs from dying	2017-12-07 21:04:09 +08:00
pom.xml	[SPARK-19112][CORE] Support for ZStandard codec	2017-11-01 14:54:08 +01:00