spark-instrumented-optimizer/sql/catalyst/src/main
Ala Luszczak 4064574d03 [SPARK-19514] Making range interruptible.
## What changes were proposed in this pull request?

Previously range operator could not be interrupted. For example, using DAGScheduler.cancelStage(...) on a query with range might have been ineffective.

This change adds periodic checks of TaskContext.isInterrupted to codegen version, and InterruptibleOperator to non-codegen version.

I benchmarked the performance of codegen version on a sample query `spark.range(1000L * 1000 * 1000 * 10).count()` and there is no measurable difference.

## How was this patch tested?

Adds a unit test.

Author: Ala Luszczak <ala@databricks.com>

Closes #16872 from ala/SPARK-19514b.
2017-02-09 19:07:06 +01:00
..
antlr4/org/apache/spark/sql/catalyst/parser [SPARK-19472][SQL] Parser should not mistake CASE WHEN(...) for a function call 2017-02-06 15:28:13 -05:00
java/org/apache/spark/sql [SPARK-19140][SS] Allow update mode for non-aggregation streaming queries 2017-01-10 17:58:11 -08:00
scala/org/apache/spark/sql [SPARK-19514] Making range interruptible. 2017-02-09 19:07:06 +01:00