Davies Liu 95e372141a [SPARK-14781] [SQL] support nested predicate subquery ... ## What changes were proposed in this pull request? In order to support nested predicate subquery, this PR introduce an internal join type ExistenceJoin, which will emit all the rows from left, plus an additional column, which presents there are any rows matched from right or not (it's not null-aware right now). This additional column could be used to replace the subquery in Filter. In theory, all the predicate subquery could use this join type, but it's slower than LeftSemi and LeftAnti, so it's only used for nested subquery (subquery inside OR). For example, the following SQL: ```sql SELECT a FROM t WHERE EXISTS (select 0) OR EXISTS (select 1) ``` This PR also fix a bug in predicate subquery push down through join (they should not). Nested null-aware subquery is still not supported. For example, `a > 3 OR b NOT IN (select bb from t)` After this, we could run TPCDS query Q10, Q35, Q45 ## How was this patch tested? Added unit tests. Author: Davies Liu <davies@databricks.com> Closes #12820 from davies/or_exists.		2016-05-02 12:58:59 -07:00
..
src	[SPARK-14781] [SQL] support nested predicate subquery	2016-05-02 12:58:59 -07:00
pom.xml	Revert "[SPARK-14613][ML] Add @Since into the matrix and vector classes in spark-mllib-local"	2016-04-28 19:57:41 -07:00