spark-instrumented-optimizer/repl
Wenchen Fan 1d04c86fc5 [SPARK-14558][CORE] In ClosureCleaner, clean the outer pointer if it's a REPL line object
## What changes were proposed in this pull request?

When we clean a closure, if its outermost parent is not a closure, we won't clone and clean it as cloning user's objects is dangerous. However, if it's a REPL line object, which may carry a lot of unnecessary references(like hadoop conf, spark conf, etc.), we should clean it as it's not a user object.

This PR improves the check for user's objects to exclude REPL line object.

## How was this patch tested?

existing tests.

Author: Wenchen Fan <wenchen@databricks.com>

Closes #12327 from cloud-fan/closure.
2016-04-14 10:58:06 -07:00
..
scala-2.10/src [SPARK-14451][SQL] Move encoder definition into Aggregator interface 2016-04-09 00:00:39 -07:00
scala-2.11/src [SPARK-14558][CORE] In ClosureCleaner, clean the outer pointer if it's a REPL line object 2016-04-14 10:58:06 -07:00
src [SPARK-14508][BUILD] Add a new ScalaStyle Rule OmitBracesInCase 2016-04-12 00:43:28 -07:00
pom.xml [SPARK-6363][BUILD] Make Scala 2.11 the default Scala version 2016-01-30 00:20:28 -08:00