ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

[SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming

Browse source 
## What changes were proposed in this pull request?
Update count distinct error message for streaming datasets/dataframes to match current behavior. These aggregations are not yet supported, regardless of whether the dataset/dataframe is aggregated.

Author: jtoka <jason.tokayer@gmail.com>

Closes #17609 from jtoka/master.
This commit is contained in:
jtoka 2017-04-12 11:36:08 +01:00 committed by Sean Owen
parent ffc57b0118
commit 2e1fd46e12
1 changed files with 2 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala
View file

@ -139,9 +139,8 @@ object UnsupportedOperationChecker {
}
throwErrorIf(
child.isStreaming && distinctAggExprs.nonEmpty,
"Distinct aggregations are not supported on streaming DataFrames/Datasets, unless " +
"it is on aggregated DataFrame/Dataset in Complete output mode. Consider using " +
"approximate distinct aggregation (e.g. approx_count_distinct() instead of count()).")
"Distinct aggregations are not supported on streaming DataFrames/Datasets. Consider " +
"using approx_count_distinct() instead.")
case _: Command =>
throwError("Commands like CreateTable*, AlterTable*, Show* are not supported with " +