6bd491ecb8
### What changes were proposed in this pull request? This PR adds additional information to ERROR log while SparkConf is modified when spark.sql.legacy.setCommandRejectsSparkCoreConfs is set ### Why are the changes needed? Right now, by default sql.legacy.setCommandRejectsSparkCoreConfs is set as true in Spark 3.* versions int order to avoid changing Spark Confs. But from the error message we get confused if we can not modify/change Spark conf in Spark 3.* or not. ### Does this PR introduce any user-facing change? Yes. Trivial change in the error messages is included ### How was this patch tested? New Test added - SPARK-36643: Show migration guide when attempting SparkConf Closes #33894 from senthh/1st_Sept_2021. Lead-authored-by: Senthil Kumar <senthh@gmail.com> Co-authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org> |
||
|---|---|---|
| .. | ||
| benchmarks | ||
| src | ||
| pom.xml | ||