ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/yarn
History
Sandy Ryza 2a4225dd94 SPARK-1639. Tidy up some Spark on YARN code 
This contains a bunch of small tidyings of the Spark on YARN code.

I focused on the yarn stable code.  @tgravescs, let me know if you'd like me to make these for the alpha code as well.

Author: Sandy Ryza <sandy@cloudera.com>

Closes #561 from sryza/sandy-spark-1639 and squashes the following commits:

72b6a02 [Sandy Ryza] Fix comment and set name on driver thread
c2190b2 [Sandy Ryza] SPARK-1639. Tidy up some Spark on YARN code
2014-06-11 07:57:28 -05:00
..
alpha SPARK-1639. Tidy up some Spark on YARN code 2014-06-11 07:57:28 -05:00
common/src SPARK-1639. Tidy up some Spark on YARN code 2014-06-11 07:57:28 -05:00
stable SPARK-1639. Tidy up some Spark on YARN code 2014-06-11 07:57:28 -05:00
pom.xml [SPARK-2029] Bump pom.xml version number of master branch to 1.1.0-SNAPSHOT. 2014-06-05 11:27:33 -07:00
README.md fix docs for yarn 2014-01-03 14:14:35 +08:00

README.md

YARN DIRECTORY LAYOUT

Hadoop Yarn related codes are organized in separate directories to minimize duplicated code.

  • common : Common codes that do not depending on specific version of Hadoop.

  • alpha / stable : Codes that involve specific version of Hadoop YARN API.

alpha represents 0.23 and 2.0.x stable represents 2.2 and later, until the API changes again.

alpha / stable will build together with common dir into a single jar