spark-instrumented-optimizer/core/src
jerryshao cd81fc9e86 [SPARK-12400][SHUFFLE] Avoid generating temp shuffle files for empty partitions
This problem lies in `BypassMergeSortShuffleWriter`, empty partition will also generate a temp shuffle file with several bytes. So here change to only create file when partition is not empty.

This problem only lies in here, no such issue in `HashShuffleWriter`.

Please help to review, thanks a lot.

Author: jerryshao <sshao@hortonworks.com>

Closes #10376 from jerryshao/SPARK-12400.
2016-01-13 16:34:23 -08:00
..
main [SPARK-12400][SHUFFLE] Avoid generating temp shuffle files for empty partitions 2016-01-13 16:34:23 -08:00
test [SPARK-12400][SHUFFLE] Avoid generating temp shuffle files for empty partitions 2016-01-13 16:34:23 -08:00