michaelzhang-db ec91818e14 [SPARK-36105][SQL] OptimizeLocalShuffleReader support reading data of multiple mappers in one task ... ### What changes were proposed in this pull request? Added another partition spec to allow OptimizeLocalShuffleReader rule to read data from multiple mappers if the parallelism is less than the number of mappers. ### Why are the changes needed? Optimization to the OptimizeLocalShuffleReader rule ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Unit tests Closes #33310 from michaelzhang-db/supportDataFromMultipleMappers. Authored-by: michaelzhang-db <michael.zhang@databricks.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com> (cherry picked from commit 094ae3708f) Signed-off-by: Wenchen Fan <wenchen@databricks.com>		2021-07-26 17:57:15 +08:00
..
benchmarks	[SPARK-34981][SQL][FOLLOWUP] Use SpecificInternalRow in ApplyFunctionExpression	2021-05-24 17:25:24 +09:00
src	[SPARK-36105][SQL] OptimizeLocalShuffleReader support reading data of multiple mappers in one task	2021-07-26 17:57:15 +08:00
pom.xml	[SPARK-35784][SS] Implementation for RocksDB instance	2021-06-29 17:46:45 -07:00