spark-instrumented-optimizer/sql/core/src/main
Tathagata Das 775cf17eaa [SPARK-14473][SQL] Define analysis rules to catch operations not supported in streaming
## What changes were proposed in this pull request?

There are many operations that are currently not supported in the streaming execution. For example:
 - joining two streams
 - unioning a stream and a batch source
 - sorting
 - window functions (not time windows)
 - distinct aggregates

Furthermore, executing a query with a stream source as a batch query should also fail.

This patch add an additional step after analysis in the QueryExecution which will check that all the operations in the analyzed logical plan is supported or not.

## How was this patch tested?
unit tests.

Author: Tathagata Das <tathagata.das1565@gmail.com>

Closes #12246 from tdas/SPARK-14473.
2016-04-18 11:09:33 -07:00
..
java/org/apache/spark/sql [SPARK-14465][BUILD] Checkstyle should check all Java files 2016-04-09 21:31:20 -07:00
resources [SPARK-12902] [SQL] visualization for generated operators 2016-01-25 12:44:20 -08:00
scala/org/apache/spark/sql [SPARK-14473][SQL] Define analysis rules to catch operations not supported in streaming 2016-04-18 11:09:33 -07:00