spark-instrumented-optimizer/external
Dongjoon Hyun 4d5247778a [SPARK-27197][SQL][TEST] Add ReadNestedSchemaTest for file-based data sources
## What changes were proposed in this pull request?

The reader schema is said to be evolved (or projected) when it changed after the data is written by writers. Apache Spark file-based data sources have a test coverage for that; e.g. [ReadSchemaSuite.scala](https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/ReadSchemaSuite.scala). This PR aims to add a test coverage for nested columns by adding and hiding nested columns.

## How was this patch tested?

Pass the Jenkins with newly added tests.

Closes #24139 from dongjoon-hyun/SPARK-27197.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: DB Tsai <d_tsai@apple.com>
2019-03-20 00:22:05 +00:00
..
avro [SPARK-27197][SQL][TEST] Add ReadNestedSchemaTest for file-based data sources 2019-03-20 00:22:05 +00:00
docker [SPARK-23038][TEST] Update docker/spark-test (JDK/OS) 2018-01-13 23:26:12 -08:00
docker-integration-tests [SPARK-27168][SQL][TEST] Add docker integration test for MsSql server 2019-03-19 08:43:23 -07:00
kafka-0-10 [SPARK-27022][DSTREAMS] Add kafka delegation token support. 2019-03-07 11:36:37 -08:00
kafka-0-10-assembly [SPARK-25956] Make Scala 2.12 as default Scala version in Spark 3.0 2018-11-14 16:22:23 -08:00
kafka-0-10-sql [SPARK-26811][SQL] Add capabilities to v2.Table 2019-03-18 18:25:11 +08:00
kafka-0-10-token-provider [SPARK-27022][DSTREAMS] Add kafka delegation token support. 2019-03-07 11:36:37 -08:00
kinesis-asl [MINOR] Simplify boolean expression 2019-02-27 08:38:00 -06:00
kinesis-asl-assembly [SPARK-25956] Make Scala 2.12 as default Scala version in Spark 3.0 2018-11-14 16:22:23 -08:00
spark-ganglia-lgpl [SPARK-25956] Make Scala 2.12 as default Scala version in Spark 3.0 2018-11-14 16:22:23 -08:00