Wenchen Fan 55cc1c991a [SPARK-14139][SQL] RowEncoder should preserve schema nullability ... ## What changes were proposed in this pull request? The problem is: In `RowEncoder`, we use `Invoke` to get the field of an external row, which lose the nullability information. This PR creates a `GetExternalRowField` expression, so that we can preserve the nullability info. TODO: simplify the null handling logic in `RowEncoder`, to remove so many if branches, in follow-up PR. ## How was this patch tested? new tests in `RowEncoderSuite` Note that, This PR takes over https://github.com/apache/spark/pull/11980, with a little simplification, so all credits should go to koertkuipers Author: Wenchen Fan <wenchen@databricks.com> Author: Koert Kuipers <koert@tresata.com> Closes #12364 from cloud-fan/nullable.		2016-05-06 01:08:04 +08:00
..
src	[SPARK-14139][SQL] RowEncoder should preserve schema nullability	2016-05-06 01:08:04 +08:00
pom.xml	Revert "[SPARK-14613][ML] Add @Since into the matrix and vector classes in spark-mllib-local"	2016-04-28 19:57:41 -07:00