bcac733bf1
### What changes were proposed in this pull request? Avoid to recompute the pending speculative tasks in the ExecutorAllocationManager, and remove some unnecessary code. ### Why are the changes needed? The number of the pending speculative tasks is recomputed in the ExecutorAllocationManager to calculate the maximum number of executors required. While , it only needs to be computed once to improve performance. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Existing tests. Closes #32306 from weixiuli/SPARK-35200. Authored-by: weixiuli <weixiuli@jd.com> Signed-off-by: Dongjoon Hyun <dhyun@apple.com> |
||
---|---|---|
.. | ||
benchmarks | ||
src | ||
pom.xml |