Maxim Gekk 43a73e387c [SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default ... ## What changes were proposed in this pull request? In the PR, I propose to use the `TIMESTAMP_MICROS` logical type for timestamps written to parquet files. The type matches semantically to Catalyst's `TimestampType`, and stores microseconds since epoch in UTC time zone. This will allow to avoid conversions of microseconds to nanoseconds and to Julian calendar. Also this will reduce sizes of written parquet files. ## How was this patch tested? By existing test suites. Closes #24425 from MaxGekk/parquet-timestamp_micros. Authored-by: Maxim Gekk <max.gekk@gmail.com> Signed-off-by: HyukjinKwon <gurwls223@apache.org>		2019-04-23 11:06:39 +09:00
..
benchmarks	[SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision	2019-04-22 19:41:32 +08:00
src	[SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default	2019-04-23 11:06:39 +09:00
v1.2.1/src	[SPARK-27182][SQL] Move the conflict source code of the sql/core module to sql/core/v1.2.1	2019-03-26 22:32:03 -07:00
v2.3.4/src	[SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4	2019-04-08 08:42:21 -07:00
pom.xml	[SPARK-27182][SQL] Move the conflict source code of the sql/core module to sql/core/v1.2.1	2019-03-26 22:32:03 -07:00