ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/external
History
Josh Rosen 07cb323e7a [SPARK-13848][SPARK-5185] Update to Py4J 0.9.2 in order to fix classloading issue 
This patch upgrades Py4J from 0.9.1 to 0.9.2 in order to include a patch which modifies Py4J to use the current thread's ContextClassLoader when performing reflection / class loading. This is necessary in order to fix [SPARK-5185](https://issues.apache.org/jira/browse/SPARK-5185), a longstanding issue affecting the use of `--jars` and `--packages` in PySpark.

In order to demonstrate that the fix works, I removed the workarounds which were added as part of [SPARK-6027](https://issues.apache.org/jira/browse/SPARK-6027) / #4779 and other patches.

Py4J diff: https://github.com/bartdag/py4j/compare/0.9.1...0.9.2

/cc zsxwing tdas davies brkyvz

Author: Josh Rosen <joshrosen@databricks.com>

Closes #11687 from JoshRosen/py4j-0.9.2.
2016-03-14 12:22:02 -07:00
..
akka [SPARK-13069][STREAMING] Add "ask" style store() to ActorReciever 2016-02-25 12:32:24 -08:00
docker [SPARK-13595][BUILD] Move docker, extras modules into external 2016-03-09 18:27:44 +00:00
docker-integration-tests [SPARK-13595][BUILD] Move docker, extras modules into external 2016-03-09 18:27:44 +00:00
flume [MINOR][DOCS] Fix more typos in comments/strings. 2016-03-14 09:07:39 +00:00
flume-assembly [SPARK-6363][BUILD] Make Scala 2.11 the default Scala version 2016-01-30 00:20:28 -08:00
flume-sink [MINOR][DOCS] Fix more typos in comments/strings. 2016-03-14 09:07:39 +00:00
java8-tests [SPARK-13595][BUILD] Move docker, extras modules into external 2016-03-09 18:27:44 +00:00
kafka [SPARK-13848][SPARK-5185] Update to Py4J 0.9.2 in order to fix classloading issue 2016-03-14 12:22:02 -07:00
kafka-assembly [SPARK-6363][BUILD] Make Scala 2.11 the default Scala version 2016-01-30 00:20:28 -08:00
kinesis-asl [SPARK-13746][TESTS] stop using deprecated SynchronizedSet 2016-03-14 09:13:29 +00:00
kinesis-asl-assembly [SPARK-13595][BUILD] Move docker, extras modules into external 2016-03-09 18:27:44 +00:00
mqtt [SPARK-13823][CORE][STREAMING][SQL] Always specify Charset in String <-> byte[] conversions (and remaining Coverity items) 2016-03-13 21:03:49 -07:00
mqtt-assembly [SPARK-6363][BUILD] Make Scala 2.11 the default Scala version 2016-01-30 00:20:28 -08:00
spark-ganglia-lgpl [SPARK-13595][BUILD] Move docker, extras modules into external 2016-03-09 18:27:44 +00:00
twitter [SPARK-13583][CORE][STREAMING] Remove unused imports and add checkstyle rule 2016-03-03 10:12:32 +00:00
zeromq [SPARK-6363][BUILD] Make Scala 2.11 the default Scala version 2016-01-30 00:20:28 -08:00