manuzhang 77a8efbc05 [SPARK-32932][SQL] Do not use local shuffle reader at final stage on write command ... ### What changes were proposed in this pull request? Do not use local shuffle reader at final stage if the root node is write command. ### Why are the changes needed? Users usually repartition with partition column on dynamic partition overwrite. AQE could break it by removing physical shuffle with local shuffle reader. That could lead to a large number of output files, even exceeding the file system limit. ### Does this PR introduce _any_ user-facing change? Yes. ### How was this patch tested? Add test. Closes #29797 from manuzhang/spark-32932. Authored-by: manuzhang <owenzhang1990@gmail.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com>		2020-10-15 05:53:32 +00:00
..
benchmarks	[SPARK-32511][SQL] Add dropFields method to Column class	2020-10-06 08:53:30 +00:00
src	[SPARK-32932][SQL] Do not use local shuffle reader at final stage on write command	2020-10-15 05:53:32 +00:00
pom.xml	[SPARK-33107][BUILD][FOLLOW-UP] Remove com.twitter:parquet-hadoop-bundle:1.6.0 and orc.classifier	2020-10-11 21:54:56 -07:00