Sameer Agarwal 4107cce58c [SPARK-2042] Prevent unnecessary shuffle triggered by take() ... This PR implements `take()` on a `SchemaRDD` by inserting a logical limit that is followed by a `collect()`. This is also accompanied by adding a catalyst optimizer rule for collapsing adjacent limits. Doing so prevents an unnecessary shuffle that is sometimes triggered by `take()`. Author: Sameer Agarwal <sameer@databricks.com> Closes #1048 from sameeragarwal/master and squashes the following commits: 3eeb848 [Sameer Agarwal] Fixing Tests 1b76ff1 [Sameer Agarwal] Deprecating limit(limitExpr: Expression) in v1.1.0 b723ac4 [Sameer Agarwal] Added limit folding tests a0ff7c4 [Sameer Agarwal] Adding catalyst rule to fold two consecutive limits 8d42d03 [Sameer Agarwal] Implement trigger() as limit() followed by collect()		2014-06-11 12:01:04 -07:00
..
src	[SPARK-2042] Prevent unnecessary shuffle triggered by take()	2014-06-11 12:01:04 -07:00
pom.xml	[SPARK-2029] Bump pom.xml version number of master branch to 1.1.0-SNAPSHOT.	2014-06-05 11:27:33 -07:00