Marcelo Vanzin 772e4648d9 [SPARK-20653][CORE] Add cleaning of old elements from the status store. ... This change restores the functionality that keeps a limited number of different types (jobs, stages, etc) depending on configuration, to avoid the store growing indefinitely over time. The feature is implemented by creating a new type (ElementTrackingStore) that wraps a KVStore and allows triggers to be set up for when elements of a certain type meet a certain threshold. Triggers don't need to necessarily only delete elements, but the current API is set up in a way that makes that use case easier. The new store also has a trigger for the "close" call, which makes it easier for listeners to register code for cleaning things up and flushing partial state to the store. The old configurations for cleaning up the stored elements from the core and SQL UIs are now active again, and the old unit tests are re-enabled. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #19751 from vanzin/SPARK-20653.		2017-12-18 14:08:48 -06:00
..
src	[SPARK-20653][CORE] Add cleaning of old elements from the status store.	2017-12-18 14:08:48 -06:00
pom.xml	[SPARK-19112][CORE] Support for ZStandard codec	2017-11-01 14:54:08 +01:00