spark-instrumented-optimizer/sql/core
DB Tsai 7911f95202 [SPARK-31064][SQL] New Parquet Predicate Filter APIs with multi-part Identifier Support
### What changes were proposed in this pull request?
Parquet's org.apache.parquet.filter2.predicate.FilterApi uses `dots` as separators to split the column name into multi-parts of nested fields. The drawback is this causes issues when the field name contains `dots`.

The new APIs that will be added will take array of string directly for multi-parts of nested fields, so no confusion as using `dots` as separators.

### Why are the changes needed?
To support nested predicate pushdown and predicate pushdown for columns containing `dots`.

### Does this PR introduce any user-facing change?
No.

### How was this patch tested?
Existing UTs.

Closes #27824 from dbtsai/SPARK-31064.

Authored-by: DB Tsai <d_tsai@apple.com>
Signed-off-by: DB Tsai <d_tsai@apple.com>
2020-03-06 21:09:24 +00:00
..
benchmarks [SPARK-30843][SQL] Fix getting of time components before 1582 year 2020-02-17 13:59:21 +08:00
src [SPARK-31064][SQL] New Parquet Predicate Filter APIs with multi-part Identifier Support 2020-03-06 21:09:24 +00:00
v1.2/src [SPARK-31058][SQL][TEST-HIVE1.2] Consolidate the implementation of quoteIfNeeded 2020-03-06 00:13:57 +00:00
v2.3/src [SPARK-31058][SQL][TEST-HIVE1.2] Consolidate the implementation of quoteIfNeeded 2020-03-06 00:13:57 +00:00
pom.xml [SPARK-30984][SS] Add UI test for Structured Streaming UI 2020-03-04 13:55:34 +08:00