Max Gekk ba13b94f6b [SPARK-33210][SQL] Set the rebasing mode for parquet INT96 type to EXCEPTION by default ... ### What changes were proposed in this pull request? 1. Set the default value for the SQL configs `spark.sql.legacy.parquet.int96RebaseModeInWrite` and `spark.sql.legacy.parquet.int96RebaseModeInRead` to `EXCEPTION`. 2. Update the SQL migration guide. ### Why are the changes needed? Current default value `LEGACY` may lead to shifting timestamps in read or in write. We should leave the decision about rebasing to users. ### Does this PR introduce _any_ user-facing change? Yes ### How was this patch tested? By existing test suites like `ParquetIOSuite`. Closes #30121 from MaxGekk/int96-exception-by-default. Authored-by: Max Gekk <max.gekk@gmail.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com>		2020-10-22 03:04:29 +00:00
..
benchmarks	[SPARK-20202][BUILD][SQL] Remove references to org.spark-project.hive (Hive 1.2.1)	2020-10-05 15:29:56 -07:00
compatibility/src/test/scala/org/apache/spark/sql/hive/execution	[SPARK-33082][SQL] Remove hive-1.2 workaround code	2020-10-07 12:27:23 -07:00
src	[SPARK-33210][SQL] Set the rebasing mode for parquet INT96 type to EXCEPTION by default	2020-10-22 03:04:29 +00:00
pom.xml	[SPARK-33107][BUILD][FOLLOW-UP] Remove com.twitter:parquet-hadoop-bundle:1.6.0 and orc.classifier	2020-10-11 21:54:56 -07:00