ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

[SPARK-36760][SQL][FOLLOWUP] Add interface SupportsPushDownV2Filters

Browse source 
### What changes were proposed in this pull request?
update java doc...

### Why are the changes needed?
to highlight the difference between this new interface `SupportsPushDownV2Filters` and the old one `SupportsPushDownFilters`

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Test not needed

Closes #34073 from huaxingao/followup.

Authored-by: Huaxin Gao <huaxin_gao@apple.com>
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
This commit is contained in:
Huaxin Gao 2021-09-23 23:48:02 +08:00 committed by Wenchen Fan
parent 9d8ac7c8e9
commit 6e815da8ea
1 changed files with 4 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/SupportsPushDownV2Filters.java
View file

@ -22,7 +22,10 @@ import org.apache.spark.sql.connector.expressions.filter.Filter;
/**
* A mix-in interface for {@link ScanBuilder}. Data sources can implement this interface to
* push down filters to the data source and reduce the size of the data to be read.
* push down V2 {@link Filter} to the data source and reduce the size of the data to be read.
* Please Note that this interface is preferred over {@link SupportsPushDownFilters}, which uses
* V1 {@link org.apache.spark.sql.sources.Filter} and is less efficient due to the
* internal -> external data conversion.
*
* @since 3.3.0
*/