ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

[SPARK-31655][BUILD] Upgrade snappy-java to 1.1.7.5

Browse source 
### What changes were proposed in this pull request?

snappy-java have release v1.1.7.5, upgrade to latest version.

Fixed in v1.1.7.4
- Caching internal buffers for SnappyFramed streams #234
- Fixed the native lib for ppc64le to work with glibc 2.17 (Previously it depended on 2.22)

Fixed in v1.1.7.5
- Fixes java.lang.NoClassDefFoundError: org/xerial/snappy/pool/DefaultPoolFactory in 1.1.7.4

https://github.com/xerial/snappy-java/compare/1.1.7.3...1.1.7.5

v 1.1.7.5 release note:
edc4ec28bd
### Why are the changes needed?
Fix bug

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
No need

Closes #28472 from AngersZhuuuu/spark-31655.

Authored-by: angerszhu <angers.zhu@gmail.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
This commit is contained in:
angerszhu 2020-05-07 12:01:43 -07:00 committed by Dongjoon Hyun
parent 272d229005
commit 0d9faf602e
No known key found for this signature in database
GPG key ID: EDA00CE834F0FC5C
4 changed files with 4 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
dev/deps/spark-deps-hadoop-2.7-hive-1.2
View file

@ -187,7 +187,7 @@ shims/0.7.45//shims-0.7.45.jar
slf4j-api/1.7.30//slf4j-api-1.7.30.jar slf4j-api/1.7.30//slf4j-api-1.7.30.jar
slf4j-log4j12/1.7.30//slf4j-log4j12-1.7.30.jar slf4j-log4j12/1.7.30//slf4j-log4j12-1.7.30.jar
snakeyaml/1.24//snakeyaml-1.24.jar snakeyaml/1.24//snakeyaml-1.24.jar
snappy-java/1.1.7.3//snappy-java-1.1.7.3.jar snappy-java/1.1.7.5//snappy-java-1.1.7.5.jar
snappy/0.2//snappy-0.2.jar snappy/0.2//snappy-0.2.jar
spire-macros_2.12/0.17.0-M1//spire-macros_2.12-0.17.0-M1.jar spire-macros_2.12/0.17.0-M1//spire-macros_2.12-0.17.0-M1.jar
spire-platform_2.12/0.17.0-M1//spire-platform_2.12-0.17.0-M1.jar spire-platform_2.12/0.17.0-M1//spire-platform_2.12-0.17.0-M1.jar

2
dev/deps/spark-deps-hadoop-2.7-hive-2.3
View file

@ -201,7 +201,7 @@ shims/0.7.45//shims-0.7.45.jar
slf4j-api/1.7.30//slf4j-api-1.7.30.jar slf4j-api/1.7.30//slf4j-api-1.7.30.jar
slf4j-log4j12/1.7.30//slf4j-log4j12-1.7.30.jar slf4j-log4j12/1.7.30//slf4j-log4j12-1.7.30.jar
snakeyaml/1.24//snakeyaml-1.24.jar snakeyaml/1.24//snakeyaml-1.24.jar
snappy-java/1.1.7.3//snappy-java-1.1.7.3.jar snappy-java/1.1.7.5//snappy-java-1.1.7.5.jar
spire-macros_2.12/0.17.0-M1//spire-macros_2.12-0.17.0-M1.jar spire-macros_2.12/0.17.0-M1//spire-macros_2.12-0.17.0-M1.jar
spire-platform_2.12/0.17.0-M1//spire-platform_2.12-0.17.0-M1.jar spire-platform_2.12/0.17.0-M1//spire-platform_2.12-0.17.0-M1.jar
spire-util_2.12/0.17.0-M1//spire-util_2.12-0.17.0-M1.jar spire-util_2.12/0.17.0-M1//spire-util_2.12-0.17.0-M1.jar

2
dev/deps/spark-deps-hadoop-3.2-hive-2.3
View file

@ -217,7 +217,7 @@ shims/0.7.45//shims-0.7.45.jar
slf4j-api/1.7.30//slf4j-api-1.7.30.jar slf4j-api/1.7.30//slf4j-api-1.7.30.jar
slf4j-log4j12/1.7.30//slf4j-log4j12-1.7.30.jar slf4j-log4j12/1.7.30//slf4j-log4j12-1.7.30.jar
snakeyaml/1.24//snakeyaml-1.24.jar snakeyaml/1.24//snakeyaml-1.24.jar
snappy-java/1.1.7.3//snappy-java-1.1.7.3.jar snappy-java/1.1.7.5//snappy-java-1.1.7.5.jar
spire-macros_2.12/0.17.0-M1//spire-macros_2.12-0.17.0-M1.jar spire-macros_2.12/0.17.0-M1//spire-macros_2.12-0.17.0-M1.jar
spire-platform_2.12/0.17.0-M1//spire-platform_2.12-0.17.0-M1.jar spire-platform_2.12/0.17.0-M1//spire-platform_2.12-0.17.0-M1.jar
spire-util_2.12/0.17.0-M1//spire-util_2.12-0.17.0-M1.jar spire-util_2.12/0.17.0-M1//spire-util_2.12-0.17.0-M1.jar

2
pom.xml
View file

@ -167,7 +167,7 @@
<scalafmt.skip>true</scalafmt.skip> <scalafmt.skip>true</scalafmt.skip>
<codehaus.jackson.version>1.9.13</codehaus.jackson.version> <codehaus.jackson.version>1.9.13</codehaus.jackson.version>
<fasterxml.jackson.version>2.10.0</fasterxml.jackson.version> <fasterxml.jackson.version>2.10.0</fasterxml.jackson.version>
<snappy.version>1.1.7.3</snappy.version> <snappy.version>1.1.7.5</snappy.version>
<netlib.java.version>1.1.2</netlib.java.version> <netlib.java.version>1.1.2</netlib.java.version>
<commons-codec.version>1.10</commons-codec.version> <commons-codec.version>1.10</commons-codec.version>
<commons-io.version>2.4</commons-io.version> <commons-io.version>2.4</commons-io.version>