spark-instrumented-optimizer/common/network-shuffle
jerryshao 93f92c0ed7 [SPARK-21475][CORE][2ND ATTEMPT] Change to use NIO's Files API for external shuffle service
## What changes were proposed in this pull request?

This PR is the second attempt of #18684 , NIO's Files API doesn't override `skip` method for `InputStream`, so it will bring in performance issue (mentioned in #20119). But using `FileInputStream`/`FileOutputStream` will also bring in memory issue (https://dzone.com/articles/fileinputstream-fileoutputstream-considered-harmful), which is severe for long running external shuffle service. So here in this proposal, only fixing the external shuffle service related code.

## How was this patch tested?

Existing tests.

Author: jerryshao <sshao@hortonworks.com>

Closes #20144 from jerryshao/SPARK-21475-v2.
2018-01-04 11:39:42 -08:00
..
src [SPARK-21475][CORE][2ND ATTEMPT] Change to use NIO's Files API for external shuffle service 2018-01-04 11:39:42 -08:00
pom.xml [SPARK-21369][CORE] Don't use Scala Tuple2 in common/network-* 2017-07-11 11:26:17 +08:00