[SPARK-26529] Add debug logs for confArchive when preparing local resource
## What changes were proposed in this pull request? Currently, `Client#createConfArchive` do not handle IOException, and some detail info is not provided in logs. Sometimes, this may delay the time of locating the root cause of io error. This PR will add debug logs for confArchive when preparing local resource. ## How was this patch tested? unittest Closes #23444 from liupc/Add-logs-for-IOException-when-preparing-local-resource. Authored-by: Liupengcheng <liupengcheng@xiaomi.com> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
This commit is contained in:
parent
311f32f37f
commit
eb42bb493b
|
@ -713,6 +713,7 @@ private[spark] class Client(
|
|||
new File(Utils.getLocalDir(sparkConf)))
|
||||
val confStream = new ZipOutputStream(new FileOutputStream(confArchive))
|
||||
|
||||
logDebug(s"Creating an archive with the config files for distribution at $confArchive.")
|
||||
try {
|
||||
confStream.setLevel(0)
|
||||
|
||||
|
|
Loading…
Reference in a new issue