spark-instrumented-optimizer/common
jinxing 93dd0c518d [SPARK-20994] Remove redundant characters in OpenBlocks to save memory for shuffle service.
## What changes were proposed in this pull request?

In current code, blockIds in `OpenBlocks` are stored in the iterator on shuffle service.
There are some redundant characters in  blockId(`"shuffle_" + shuffleId + "_" + mapId + "_" + reduceId`). This pr proposes to improve the footprint and alleviate the memory pressure on shuffle service.

Author: jinxing <jinxing6042@126.com>

Closes #18231 from jinxing64/SPARK-20994-v2.
2017-06-16 20:09:45 +08:00
..
kvstore [SPARK-20641][CORE] Add key-value store abstraction and LevelDB implementation. 2017-06-06 13:39:10 -05:00
network-common [SPARK-19659] Fetch big blocks to disk when shuffle-read. 2017-05-25 16:11:30 +08:00
network-shuffle [SPARK-20994] Remove redundant characters in OpenBlocks to save memory for shuffle service. 2017-06-16 20:09:45 +08:00
network-yarn [SPARK-20756][YARN] yarn-shuffle jar references unshaded guava 2017-05-22 10:10:41 -07:00
sketch [SPARK-20453] Bump master branch version to 2.3.0-SNAPSHOT 2017-04-24 21:48:04 -07:00
tags [SPARK-20453] Bump master branch version to 2.3.0-SNAPSHOT 2017-04-24 21:48:04 -07:00
unsafe [SPARK-20750][SQL] Built-in SQL Function Support - REPLACE 2017-05-29 11:47:31 -07:00