Nong Li 5989c85b53 [SPARK-14217] [SQL] Fix bug if parquet data has columns that use dictionary encoding for some of the data ... ## What changes were proposed in this pull request? This PR is based on #12017 Currently, this causes batches where some values are dictionary encoded and some which are not. The non-dictionary encoded values cause us to remove the dictionary from the batch causing the first values to return garbage. This patch fixes the issue by first decoding the dictionary for the values that are already dictionary encoded before switching. A similar thing is done for the reverse case where the initial values are not dictionary encoded. ## How was this patch tested? This is difficult to test but replicated on a test cluster using a large tpcds data set. Author: Nong Li <nong@databricks.com> Author: Davies Liu <davies@databricks.com> Closes #12279 from davies/fix_dict.		2016-04-09 17:45:10 -07:00
..
src	[SPARK-14217] [SQL] Fix bug if parquet data has columns that use dictionary encoding for some of the data	2016-04-09 17:45:10 -07:00
pom.xml	[SPARK-14103][SQL] Parse unescaped quotes in CSV data source.	2016-04-08 00:28:59 -07:00