spark-instrumented-optimizer/sql/hive
Nathan Howell c82f16c15e [SPARK-18658][SQL] Write text records directly to a FileOutputStream
## What changes were proposed in this pull request?

This replaces uses of `TextOutputFormat` with an `OutputStream`, which will either write directly to the filesystem or indirectly via a compressor (if so configured). This avoids intermediate buffering.

The inverse of this (reading directly from a stream) is necessary for streaming large JSON records (when `wholeFile` is enabled) so I wanted to keep the read and write paths symmetric.

## How was this patch tested?

Existing unit tests.

Author: Nathan Howell <nhowell@godaddy.com>

Closes #16089 from NathanHowell/SPARK-18658.
2016-12-01 21:40:49 -08:00
..
compatibility/src/test/scala/org/apache/spark/sql/hive/execution [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry 2016-11-07 01:16:37 -08:00
src [SPARK-18658][SQL] Write text records directly to a FileOutputStream 2016-12-01 21:40:49 -08:00
pom.xml [SPARK-16535][BUILD] In pom.xml, remove groupId which is redundant definition and inherited from the parent 2016-07-19 11:59:46 +01:00