spark-instrumented-optimizer/sql/hive
Davies Liu aec502d911 [SPARK-15654] [SQL] fix non-splitable files for text based file formats
## What changes were proposed in this pull request?

Currently, we always split the files when it's bigger than maxSplitBytes, but Hadoop LineRecordReader does not respect the splits for compressed files correctly, we should have a API for FileFormat to check whether the file could be splitted or not.

This PR is based on #13442, closes #13442

## How was this patch tested?

add regression tests.

Author: Davies Liu <davies@databricks.com>

Closes #13531 from davies/fix_split.
2016-06-10 14:32:43 -07:00
..
compatibility/src/test/scala/org/apache/spark/sql/hive/execution [SPARK-15539][SQL] DROP TABLE throw exception if table doesn't exist 2016-05-26 12:04:18 -07:00
src [SPARK-15654] [SQL] fix non-splitable files for text based file formats 2016-06-10 14:32:43 -07:00
pom.xml [SPARK-15290][BUILD] Move annotations, like @Since / @DeveloperApi, into spark-tags 2016-05-17 09:55:53 +01:00