spark-instrumented-optimizer/core
Matei Zaharia 599dcb0ddf Merge pull request #74 from rxin/kill
Job cancellation via job group id.

This PR adds a simple API to group together a set of jobs belonging to a thread and threads spawned from it. It also allows the cancellation of all jobs in this group.

An example:

    sc.setJobDescription("this_is_the_group_id", "some job description")
    sc.parallelize(1 to 10000, 2).map { i => Thread.sleep(10); i }.count()

In a separate thread:

    sc.cancelJobGroup("this_is_the_group_id")
2013-10-18 22:49:00 -07:00
..
src Merge pull request #74 from rxin/kill 2013-10-18 22:49:00 -07:00
pom.xml Add a zookeeper compile dependency to fix build in maven 2013-10-11 16:31:47 +08:00