094ae3708f
### What changes were proposed in this pull request? Added another partition spec to allow OptimizeLocalShuffleReader rule to read data from multiple mappers if the parallelism is less than the number of mappers. ### Why are the changes needed? Optimization to the OptimizeLocalShuffleReader rule ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Unit tests Closes #33310 from michaelzhang-db/supportDataFromMultipleMappers. Authored-by: michaelzhang-db <michael.zhang@databricks.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com> |
||
|---|---|---|
| .. | ||
| benchmarks | ||
| src | ||
| pom.xml | ||