ulysses-you 1be1012497 [SPARK-35005][SQL] Improve error msg if UTF8String concatWs length overflow ... ### What changes were proposed in this pull request? Add check if the byte length over `int`. ### Why are the changes needed? We encounter a very extreme case with expression `concat_ws`, and the error msg is ``` Caused by: java.lang.NegativeArraySizeException at org.apache.spark.unsafe.types.UTF8String.concatWs ``` Seems the `UTF8String.concat` has already done the length check at [#21064](https://github.com/apache/spark/pull/21064), so it's better to add in `concatWs`. ### Does this PR introduce _any_ user-facing change? Yes ### How was this patch tested? It's too heavy to add the test. Closes #32106 from ulysses-you/SPARK-35005. Authored-by: ulysses-you <ulyssesyou18@gmail.com> Signed-off-by: Max Gekk <max.gekk@gmail.com>		2021-04-12 14:32:15 +03:00
..
src	[SPARK-35005][SQL] Improve error msg if UTF8String concatWs length overflow	2021-04-12 14:32:15 +03:00
pom.xml	[SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT	2020-12-04 14:10:42 -08:00