spark-instrumented-optimizer/common
Marcelo Vanzin 0e9a750a8d [SPARK-20643][CORE] Add listener implementation to collect app state.
The initial listener code is based on the existing JobProgressListener (and others),
and tries to mimic their behavior as much as possible. The change also includes
some minor code movement so that some types and methods from the initial history
server code code can be reused.

The code introduces a few mutable versions of public API types, used internally,
to make it easier to update information without ugly copy methods, and also to
make certain updates cheaper.

Note the code here is not 100% correct. This is meant as a building ground for
the UI integration in the next milestones. As different parts of the UI are
ported, fixes will be made to the different parts of this code to account
for the needed behavior.

I also added annotations to API types so that Jackson is able to correctly
deserialize options, sequences and maps that store primitive types.

Author: Marcelo Vanzin <vanzin@cloudera.com>

Closes #19383 from vanzin/SPARK-20643.
2017-10-26 11:05:16 -05:00
..
kvstore [SPARK-20643][CORE] Add listener implementation to collect app state. 2017-10-26 11:05:16 -05:00
network-common [SPARK-22066][BUILD] Update checkstyle to 8.2, enable it, fix violations 2017-09-20 10:01:46 +01:00
network-shuffle [SPARK-22062][CORE] Spill large block to disk in BlockManager's remote fetch to avoid OOM 2017-10-17 22:54:38 +08:00
network-yarn [SPARK-17321][YARN] Avoid writing shuffle metadata to disk if NM recovery is disabled 2017-08-31 09:26:20 +08:00
sketch [SPARK-22066][BUILD] Update checkstyle to 8.2, enable it, fix violations 2017-09-20 10:01:46 +01:00
tags [SPARK-20453] Bump master branch version to 2.3.0-SNAPSHOT 2017-04-24 21:48:04 -07:00
unsafe [SPARK-22349] In on-heap mode, when allocating memory from pool,we should fill memory with MEMORY_DEBUG_FILL_CLEAN_VALUE 2017-10-25 21:34:00 +05:30