55373b118f
### What changes were proposed in this pull request? The code of method: createDirectory in class: org.apache.spark.util.Utils is modified. ### Why are the changes needed? To solve the problem of ambiguous exception handling in traditional IO creating directories. What's more, there shouldn't be an improper comment in Spark's source code. ### Does this PR introduce _any_ user-facing change? Yes The modified method would be called to create the working directory when Worker starts. The modified method would be called to create local directories for storing block data when the class: DiskBlockManager instantiates. The modified method would be called to create a temporary directory inside the given parent directory in several classes. ### How was this patch tested? I have provided test cases as much as possible. Authored-by: Shockang <shockangaliyun.com> Closes #33101 from Shockang/SPARK-35907. Authored-by: Shockang <shockang@163.com> Signed-off-by: Sean Owen <srowen@gmail.com> |
||
|---|---|---|
| .. | ||
| benchmarks | ||
| src | ||
| pom.xml | ||