Nong Li 0598a2b81d [SPARK-13499] [SQL] Performance improvements for parquet reader. ... ## What changes were proposed in this pull request? This patch includes these performance fixes: - Remove unnecessary setNotNull() calls. The NULL bits are cleared already. - Speed up RLE group decoding - Speed up dictionary decoding by decoding NULLs directly into the result. ## How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) In addition to the updated benchmarks, on TPCDS, the result of these changes running Q55 (sf40) is: ``` TPCDS: Best/Avg Time(ms) Rate(M/s) Per Row(ns) --------------------------------------------------------------------------------- q55 (Before) 6398 / 6616 18.0 55.5 q55 (After) 4983 / 5189 23.1 43.3 ``` Author: Nong Li <nong@databricks.com> Closes #11375 from nongli/spark-13499.		2016-02-26 12:43:50 -08:00
..
main	[SPARK-13499] [SQL] Performance improvements for parquet reader.	2016-02-26 12:43:50 -08:00
test	[SPARK-13499] [SQL] Performance improvements for parquet reader.	2016-02-26 12:43:50 -08:00