Kent Yao 4fd585d2c5 [SPARK-30008][SQL] The dataType of collect_list/collect_set aggs should be ArrayType(_, false) ... ### What changes were proposed in this pull request? ```scala // Do not allow null values. We follow the semantics of Hive's collect_list/collect_set here. // See: org.apache.hadoop.hive.ql.udf.generic.GenericUDAFMkCollectionEvaluator ``` These two functions do not allow null values as they are defined, so their elements should not contain null. ### Why are the changes needed? Casting collect_list(a) to ArrayType(_, false) fails before this fix. ### Does this PR introduce any user-facing change? no ### How was this patch tested? add ut Closes #26651 from yaooqinn/SPARK-30008. Authored-by: Kent Yao <yaooqinn@hotmail.com> Signed-off-by: Dongjoon Hyun <dhyun@apple.com>		2019-11-26 20:40:21 -08:00
..
main	[SPARK-30008][SQL] The dataType of collect_list/collect_set aggs should be ArrayType(_, false)	2019-11-26 20:40:21 -08:00
test	[SPARK-30008][SQL] The dataType of collect_list/collect_set aggs should be ArrayType(_, false)	2019-11-26 20:40:21 -08:00