ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/sql/core/src
History
Shixiong Zhu 56a503df5c [SPARK-18670][SS] Limit the number of StreamingQueryListener.StreamProgressEvent when there is no data 
## What changes were proposed in this pull request?

This PR adds a sql conf `spark.sql.streaming.noDataReportInterval` to control how long to wait before outputing the next StreamProgressEvent when there is no data.

## How was this patch tested?

The added unit test.

Author: Shixiong Zhu <shixiong@databricks.com>

Closes #16108 from zsxwing/SPARK-18670.
2016-12-02 12:42:47 -08:00
..
main [SPARK-18670][SS] Limit the number of StreamingQueryListener.StreamProgressEvent when there is no data 2016-12-02 12:42:47 -08:00
test [SPARK-18670][SS] Limit the number of StreamingQueryListener.StreamProgressEvent when there is no data 2016-12-02 12:42:47 -08:00