jerryshao 93f92c0ed7 [SPARK-21475][CORE][2ND ATTEMPT] Change to use NIO's Files API for external shuffle service ... ## What changes were proposed in this pull request? This PR is the second attempt of #18684 , NIO's Files API doesn't override `skip` method for `InputStream`, so it will bring in performance issue (mentioned in #20119). But using `FileInputStream`/`FileOutputStream` will also bring in memory issue (https://dzone.com/articles/fileinputstream-fileoutputstream-considered-harmful), which is severe for long running external shuffle service. So here in this proposal, only fixing the external shuffle service related code. ## How was this patch tested? Existing tests. Author: jerryshao <sshao@hortonworks.com> Closes #20144 from jerryshao/SPARK-21475-v2.		2018-01-04 11:39:42 -08:00
..
kvstore	[MINOR] Fix a bunch of typos	2018-01-02 07:10:19 +09:00
network-common	[SPARK-21475][CORE][2ND ATTEMPT] Change to use NIO's Files API for external shuffle service	2018-01-04 11:39:42 -08:00
network-shuffle	[SPARK-21475][CORE][2ND ATTEMPT] Change to use NIO's Files API for external shuffle service	2018-01-04 11:39:42 -08:00
network-yarn	[SPARK-17321][YARN] Avoid writing shuffle metadata to disk if NM recovery is disabled	2017-08-31 09:26:20 +08:00
sketch	[MINOR] Fix a bunch of typos	2018-01-02 07:10:19 +09:00
tags	[SPARK-20453] Bump master branch version to 2.3.0-SNAPSHOT	2017-04-24 21:48:04 -07:00
unsafe	[MINOR] Fix a bunch of typos	2018-01-02 07:10:19 +09:00