ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

[SQL] Upgrade parquet library.

Browse source 
I think we are hitting this issue in some perf tests: 6aed5288fd

Credit to @aarondav !

Author: Michael Armbrust <michael@databricks.com>

Closes #684 from marmbrus/upgradeParquet and squashes the following commits:

e10a619 [Michael Armbrust] Upgrade parquet library.
This commit is contained in:
Michael Armbrust 2014-05-10 11:48:01 -07:00 committed by Patrick Wendell
parent 561510867a
commit 4d60553298
2 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
pom.xml
View file

@ -123,7 +123,7 @@
<yarn.version>${hadoop.version}</yarn.version> <yarn.version>${hadoop.version}</yarn.version>
<hbase.version>0.94.6</hbase.version> <hbase.version>0.94.6</hbase.version>
<hive.version>0.12.0</hive.version> <hive.version>0.12.0</hive.version>
<parquet.version>1.3.2</parquet.version> <parquet.version>1.4.3</parquet.version>
<jblas.version>1.2.3</jblas.version> <jblas.version>1.2.3</jblas.version>
<jetty.version>8.1.14.v20131031</jetty.version> <jetty.version>8.1.14.v20131031</jetty.version>
<chill.version>0.3.6</chill.version> <chill.version>0.3.6</chill.version>

2
project/SparkBuild.scala
View file

@ -300,7 +300,7 @@ object SparkBuild extends Build {
val jets3tVersion = if ("^2\\.[3-9]+".r.findFirstIn(hadoopVersion).isDefined) "0.9.0" else "0.7.1" val jets3tVersion = if ("^2\\.[3-9]+".r.findFirstIn(hadoopVersion).isDefined) "0.9.0" else "0.7.1"
val jettyVersion = "8.1.14.v20131031" val jettyVersion = "8.1.14.v20131031"
val hiveVersion = "0.12.0" val hiveVersion = "0.12.0"
val parquetVersion = "1.3.2" val parquetVersion = "1.4.3"
val slf4jVersion = "1.7.5" val slf4jVersion = "1.7.5"
val excludeNetty = ExclusionRule(organization = "org.jboss.netty") val excludeNetty = ExclusionRule(organization = "org.jboss.netty")