spark-instrumented-optimizer/sql/core/src
Henry Robinson 8c5b34c425 [SPARK-23604][SQL] Change Statistics.isEmpty to !Statistics.hasNonNul…
…lValue

## What changes were proposed in this pull request?

Parquet 1.9 will change the semantics of Statistics.isEmpty slightly
to reflect if the null value count has been set. That breaks a
timestamp interoperability test that cares only about whether there
are column values present in the statistics of a written file for an
INT96 column. Fix by using Statistics.hasNonNullValue instead.

## How was this patch tested?

Unit tests continue to pass against Parquet 1.8, and also pass against
a Parquet build including PARQUET-1217.

Author: Henry Robinson <henry@cloudera.com>

Closes #20740 from henryr/spark-23604.
2018-03-05 16:49:24 -08:00
..
main [SPARK-23559][SS] Add epoch ID to DataWriterFactory. 2018-03-05 13:23:01 -08:00
test [SPARK-23604][SQL] Change Statistics.isEmpty to !Statistics.hasNonNul… 2018-03-05 16:49:24 -08:00