Ahir Reddy e53eb4f015 [SPARK-986]: Job cancelation for PySpark ... * Additions to the PySpark API to cancel jobs * Monitor Thread in PythonRDD to kill Python workers if a task is interrupted Author: Ahir Reddy <ahirreddy@gmail.com> Closes #541 from ahirreddy/python-cancel and squashes the following commits: dfdf447 [Ahir Reddy] Changed success -> completed and made logging message clearer 6c860ab [Ahir Reddy] PR Comments 4b4100a [Ahir Reddy] Success flag adba6ed [Ahir Reddy] Destroy python workers 27a2f8f [Ahir Reddy] Start the writer thread... d422f7b [Ahir Reddy] Remove unnecesssary vals adda337 [Ahir Reddy] Busy wait on the ocntext.interrupted flag, and then kill the python worker d9e472f [Ahir Reddy] Revert "removed unnecessary vals" 5b9cae5 [Ahir Reddy] removed unnecessary vals 07b54d9 [Ahir Reddy] Fix canceling unit test 8ae9681 [Ahir Reddy] Don't interrupt worker 7722342 [Ahir Reddy] Monitor Thread for python workers db04e16 [Ahir Reddy] Added canceling api to PySpark		2014-04-24 20:21:10 -07:00
..
mllib	fix bugs of dot in python	2014-04-22 11:06:18 -07:00
__init__.py	SPARK-1374: PySpark API for SparkSQL	2014-04-15 00:07:55 -07:00
accumulators.py	Add custom serializer support to PySpark.	2013-11-10 16:45:38 -08:00
broadcast.py	Fix some Python docs and make sure to unset SPARK_TESTING in Python	2013-12-29 20:15:07 -05:00
cloudpickle.py	Rename top-level 'pyspark' directory to 'python'	2013-01-01 15:05:00 -08:00
conf.py	SPARK-1114: Allow PySpark to use existing JVM and Gateway	2014-02-20 21:20:39 -08:00
context.py	[SPARK-986]: Job cancelation for PySpark	2014-04-24 20:21:10 -07:00
daemon.py	Add Apache license headers and LICENSE and NOTICE files	2013-07-16 17:21:33 -07:00
files.py	Initial work to rename package to org.apache.spark	2013-09-01 14:13:13 -07:00
java_gateway.py	SPARK-1374: PySpark API for SparkSQL	2014-04-15 00:07:55 -07:00
join.py	Spark 1271: Co-Group and Group-By should pass Iterable[X]	2014-04-08 18:15:59 -07:00
rdd.py	SPARK-1438 RDD.sample() make seed param optional	2014-04-24 17:27:16 -07:00
rddsampler.py	SPARK-1438 RDD.sample() make seed param optional	2014-04-24 17:27:16 -07:00
resultiterable.py	Spark 1271: Co-Group and Group-By should pass Iterable[X]	2014-04-08 18:15:59 -07:00
serializers.py	SPARK-1421. Make MLlib work on Python 2.6	2014-04-05 20:52:05 -07:00
shell.py	Fixed broken pyspark shell.	2014-04-18 10:10:13 -07:00
sql.py	Add insertInto and saveAsTable to Python API.	2014-04-19 15:08:54 -07:00
statcounter.py	Spark 1246 add min max to stat counter	2014-03-18 00:45:47 -07:00
storagelevel.py	SPARK-1305: Support persisting RDD's directly to Tachyon	2014-04-04 20:38:20 -07:00
tests.py	Fix for SPARK-1025: PySpark hang on missing files.	2014-01-23 18:24:51 -08:00
worker.py	SPARK-1115: Catch depickling errors	2014-02-26 14:51:21 -08:00