484b50cadf
### What changes were proposed in this pull request? Change `currentPhysicalPlan.logicalLink.get` to `inputPlan.logicalLink.get` for initial logical link. ### Why are the changes needed? At `initialPlan` we may remove some Spark Plan with `queryStagePreparationRules`, if removed Spark Plan is top level node, then we will lose the linked logical node. Since we support AQE side broadcast join config. It's more common that a join is SMJ at normal planner and changed to BHJ after AQE reOptimize. However, `RemoveRedundantSorts` is applied before reOptimize at `initialPlan`, then a local sort might be removed incorrectly if a join is SMJ at first but changed to BHJ during reOptimize. ### Does this PR introduce _any_ user-facing change? yes, bug fix ### How was this patch tested? add test Closes #33244 from ulysses-you/SPARK-36032. Authored-by: ulysses-you <ulyssesyou18@gmail.com> Signed-off-by: Liang-Chi Hsieh <viirya@gmail.com> |
||
|---|---|---|
| .. | ||
| benchmarks | ||
| src | ||
| pom.xml | ||