spark-instrumented-optimizer/sql/catalyst
Liang-Chi Hsieh 4637fc08a3 [SPARK-11955][SQL] Mark optional fields in merging schema for safely pushdowning filters in Parquet
JIRA: https://issues.apache.org/jira/browse/SPARK-11955

Currently we simply skip pushdowning filters in parquet if we enable schema merging.

However, we can actually mark particular fields in merging schema for safely pushdowning filters in parquet.

Author: Liang-Chi Hsieh <viirya@appier.com>
Author: Liang-Chi Hsieh <viirya@gmail.com>

Closes #9940 from viirya/safe-pushdown-parquet-filters.
2016-01-28 16:25:21 -08:00
..
src [SPARK-11955][SQL] Mark optional fields in merging schema for safely pushdowning filters in Parquet 2016-01-28 16:25:21 -08:00
pom.xml [SPARK-12573][SPARK-12574][SQL] Move SQL Parser from Hive to Catalyst 2016-01-06 11:16:53 -08:00