spark-instrumented-optimizer/sql/catalyst/src/main
Maxim Gekk 76813cfa1e [SPARK-25950][SQL] from_csv should respect to spark.sql.columnNameOfCorruptRecord
## What changes were proposed in this pull request?

Fix for `CsvToStructs` to take into account SQL config `spark.sql.columnNameOfCorruptRecord` similar to `from_json`.

## How was this patch tested?

Added new test where `spark.sql.columnNameOfCorruptRecord` is set to corrupt column name different from default.

Closes #22956 from MaxGekk/csv-tests.

Authored-by: Maxim Gekk <max.gekk@gmail.com>
Signed-off-by: hyukjinkwon <gurwls223@apache.org>
2018-11-07 11:26:17 +08:00
..
antlr4/org/apache/spark/sql/catalyst/parser [SPARK-25269][SQL] SQL interface support specify StorageLevel when cache table 2018-10-19 09:15:55 -07:00
java/org/apache/spark/sql [SPARK-25408] Move to more ideomatic Java8 2018-10-08 09:58:52 -05:00
scala/org/apache/spark/sql [SPARK-25950][SQL] from_csv should respect to spark.sql.columnNameOfCorruptRecord 2018-11-07 11:26:17 +08:00