515708d5f3
## What changes were proposed in this pull request? Switch `org.apache.hive.service.server.HiveServer2` to register its shutdown callback with Spark's `ShutdownHookManager`, rather than direct with the Java Runtime callback. This avoids race conditions in shutdown where the filesystem is shutdown before the flush/write/rename of the event log is completed, particularly on object stores where the write and rename can be slow. ## How was this patch tested? There's no explicit unit for test this, which is consistent with every other shutdown hook in the codebase. * There's an implicit test when the scalatest process is halted. * More manual/integration testing is needed. HADOOP-15679 has added the ability to explicitly execute the hadoop shutdown hook sequence which spark uses; that could be stabilized for testing if desired, after which all the spark hooks could be tested. Until then: external system tests only. Author: Steve Loughran <stevel@hortonworks.com> Closes #22186 from steveloughran/BUG/SPARK-25183-shutdown. |
||
|---|---|---|
| .. | ||
| if | ||
| src | ||
| pom.xml | ||