Max Gekk 6c80ebbccb [SPARK-31818][SQL] Fix pushing down filters with java.time.Instant values in ORC ... ### What changes were proposed in this pull request? Convert `java.time.Instant` to `java.sql.Timestamp` in pushed down filters to ORC datasource when Java 8 time API enabled. ### Why are the changes needed? The changes fix the exception raised while pushing date filters when `spark.sql.datetime.java8API.enabled` is set to `true`: ``` java.lang.IllegalArgumentException: Wrong value class java.time.Instant for TIMESTAMP.EQUALS leaf at org.apache.hadoop.hive.ql.io.sarg.SearchArgumentImpl$PredicateLeafImpl.checkLiteralType(SearchArgumentImpl.java:192) at org.apache.hadoop.hive.ql.io.sarg.SearchArgumentImpl$PredicateLeafImpl.<init>(SearchArgumentImpl.java:75) ``` ### Does this PR introduce any user-facing change? Yes ### How was this patch tested? Added tests to `OrcFilterSuite`. Closes #28636 from MaxGekk/orc-timestamp-filter-pushdown. Authored-by: Max Gekk <max.gekk@gmail.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>		2020-05-25 18:36:02 -07:00
..
main	[SPARK-31818][SQL] Fix pushing down filters with java.time.Instant values in ORC	2020-05-25 18:36:02 -07:00
test/scala/org/apache/spark/sql/execution/datasources/orc	[SPARK-31818][SQL] Fix pushing down filters with java.time.Instant values in ORC	2020-05-25 18:36:02 -07:00