ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/sql/catalyst/src/main
History
Liang-Chi Hsieh f373986997 [SPARK-13383][SQL] Keep broadcast hint after column pruning 
JIRA: https://issues.apache.org/jira/browse/SPARK-13383

## What changes were proposed in this pull request?

When we do column pruning in Optimizer, we put additional Project on top of a logical plan. However, when we already wrap a BroadcastHint on a logical plan, the added Project will hide BroadcastHint after later execution.

We should take care of BroadcastHint when we do column pruning.

## How was the this patch tested?

Unit test is added.

Author: Liang-Chi Hsieh <viirya@gmail.com>

Closes #11260 from viirya/keep-broadcasthint.
2016-02-24 10:22:40 -08:00
..
antlr3/org/apache/spark/sql/catalyst/parser [SPARK-13431] [SQL] [test-maven] split keywords from ExpressionParser.g 2016-02-23 21:22:00 -08:00
java/org/apache/spark/sql [SPARK-12854][SQL] Implement complex types support in ColumnarBatch 2016-01-26 17:34:01 -08:00
scala/org/apache/spark/sql [SPARK-13383][SQL] Keep broadcast hint after column pruning 2016-02-24 10:22:40 -08:00