2e28622d8a
### What changes were proposed in this pull request? This is the next step of the Spark-25299 work of proposing a new Shuffle storage API. This patch includes the components of the plugin that hook into the driver, including driver shuffle initialization, application cleanup, and shuffle cleanup. ### How was this patch tested? Existing unit tests, plus an additional test for testing the interactions between the driver and executor initialization. Closes #25823 from yifeih/yh/upstream/driver-lifecycle. Lead-authored-by: Yifei Huang <yifeih@palantir.com> Co-authored-by: mccheah <mcheah@palantir.com> Signed-off-by: Imran Rashid <irashid@cloudera.com> |
||
---|---|---|
.. | ||
benchmarks | ||
src | ||
pom.xml |