a03fbfbdd5
### What changes were proposed in this pull request? Assert the number of blocks to fetch equals the number of local blocks + the number of hostLocal blocks + the number of remote blocks in ShuffleBlockFetcherIterator. Also refactor the code a bit to make it easier to follow. ### Why are the changes needed? When the numbers don't match it means something is going wrong, we should fail fast. ### Does this PR introduce any user-facing change? No. This is basically code refactoring. ### How was this patch tested? Tested with existing test suites. Closes #27972 from jiangxb1987/BlockFetcher. Authored-by: Xingbo Jiang <xingbo.jiang@databricks.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com> |
||
|---|---|---|
| .. | ||
| benchmarks | ||
| src | ||
| pom.xml | ||