yangjie01 b46a9f3b0f [SPARK-36242][CORE] Ensure spill file closed before set success = true in ExternalSorter.spillMemoryIteratorToDisk method ... ### What changes were proposed in this pull request? The main change of this pr is move `writer.close()` before `success = true` to ensure spill file closed before set `success = true` in `ExternalSorter.spillMemoryIteratorToDisk` method. ### Why are the changes needed? Avoid setting `success = true` first and then failure of close spill file ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? - Pass the Jenkins or GitHub Action - Add a new Test case to check `The spill file should not exists if writer close fails` Closes #33460 from LuciferYang/external-sorter-spill-close. Authored-by: yangjie01 <yangjie01@baidu.com> Signed-off-by: yi.wu <yi.wu@databricks.com> (cherry picked from commit f61d5993ea) Signed-off-by: yi.wu <yi.wu@databricks.com>		2021-07-23 23:18:51 +08:00
..
benchmarks	[SPARK-35670][BUILD] Upgrade ZSTD-JNI to 1.5.0-2	2021-06-17 11:06:50 -07:00
src	[SPARK-36242][CORE] Ensure spill file closed before set success = true in ExternalSorter.spillMemoryIteratorToDisk method	2021-07-23 23:18:51 +08:00
pom.xml	[SPARK-35928][BUILD] Upgrade ASM to 9.1	2021-06-29 10:27:51 -07:00