de66fa63f9
### What changes were proposed in this pull request? Improve dynamic partition pruning evaluation to make filtering side must can broadcast by size or broadcast by hint. ### Why are the changes needed? 1. Fast fail if filtering side can not broadcast by size or broadcast by hint. 2. We can safely disable `spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly`. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Existing unit test. Closes #31984 from wangyum/SPARK-34884. Authored-by: Yuming Wang <yumwang@ebay.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com> |
||
---|---|---|
.. | ||
benchmarks | ||
src | ||
pom.xml |