spark-instrumented-optimizer/python/pyspark
Matei Zaharia 60e18ce7dd SPARK-1414. Python API for SparkContext.wholeTextFiles
Also clarified comment on each file having to fit in memory

Author: Matei Zaharia <matei@databricks.com>

Closes #327 from mateiz/py-whole-files and squashes the following commits:

9ad64a5 [Matei Zaharia] SPARK-1414. Python API for SparkContext.wholeTextFiles
2014-04-04 17:29:29 -07:00
..
mllib [SPARK-1212, Part II] Support sparse data in MLlib 2014-04-02 14:01:12 -07:00
__init__.py Changes on top of Prashant's patch. 2014-01-03 18:30:17 -08:00
accumulators.py Add custom serializer support to PySpark. 2013-11-10 16:45:38 -08:00
broadcast.py Fix some Python docs and make sure to unset SPARK_TESTING in Python 2013-12-29 20:15:07 -05:00
cloudpickle.py Rename top-level 'pyspark' directory to 'python' 2013-01-01 15:05:00 -08:00
conf.py SPARK-1114: Allow PySpark to use existing JVM and Gateway 2014-02-20 21:20:39 -08:00
context.py SPARK-1414. Python API for SparkContext.wholeTextFiles 2014-04-04 17:29:29 -07:00
daemon.py Add Apache license headers and LICENSE and NOTICE files 2013-07-16 17:21:33 -07:00
files.py Initial work to rename package to org.apache.spark 2013-09-01 14:13:13 -07:00
java_gateway.py SPARK-929: Fully deprecate usage of SPARK_MEM 2014-03-09 11:08:39 -07:00
join.py Change numSplits to numPartitions in PySpark. 2013-02-24 13:25:09 -08:00
rdd.py Spark 1162 Implemented takeOrdered in pyspark. 2014-04-03 15:42:17 -07:00
rddsampler.py RDD sample() and takeSample() prototypes for PySpark 2013-08-28 16:46:13 -07:00
serializers.py SPARK-1414. Python API for SparkContext.wholeTextFiles 2014-04-04 17:29:29 -07:00
shell.py Merge pull request #542 from markhamstra/versionBump. Closes #542. 2014-02-08 16:00:43 -08:00
statcounter.py Spark 1246 add min max to stat counter 2014-03-18 00:45:47 -07:00
storagelevel.py Spark-1163, Added missing Python RDD functions 2014-03-11 23:57:05 -07:00
tests.py Fix for SPARK-1025: PySpark hang on missing files. 2014-01-23 18:24:51 -08:00
worker.py SPARK-1115: Catch depickling errors 2014-02-26 14:51:21 -08:00