ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/python/pyspark
History
Josh Rosen b95732632b Do not inherit master's PYTHONPATH on workers. 
This fixes SPARK-832, an issue where PySpark
would not work when the master and workers used
different SPARK_HOME paths.

This change may potentially break code that relied
on the master's PYTHONPATH being used on workers.
To have custom PYTHONPATH additions used on the
workers, users should set a custom PYTHONPATH in
spark-env.sh rather than setting it in the shell.
2013-07-29 22:08:57 -07:00
..
__init__.py Don't download files to master's working directory. 2013-01-21 17:34:17 -08:00
accumulators.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00
broadcast.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00
cloudpickle.py Rename top-level 'pyspark' directory to 'python' 2013-01-01 15:05:00 -08:00
context.py SPARK-815. Python parallelize() should split lists before batching 2013-07-29 02:51:43 -04:00
daemon.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00
files.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00
java_gateway.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00
join.py Change numSplits to numPartitions in PySpark. 2013-02-24 13:25:09 -08:00
rdd.py Do not inherit master's PYTHONPATH on workers. 2013-07-29 22:08:57 -07:00
serializers.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00
shell.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00
tests.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00
worker.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00