ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/yarn
History
witgo fb0543224b The default version of yarn is equal to the hadoop version 
This is a part of [PR 590](https://github.com/apache/spark/pull/590)

Author: witgo <witgo@qq.com>

Closes #626 from witgo/yarn_version and squashes the following commits:

c390631 [witgo] restore  the yarn dependency declarations
f8a4ad8 [witgo] revert remove the dependency of avro in yarn-alpha
2df6cf5 [witgo] review commit
a1d876a [witgo] review commit
20e7e3e [witgo] review commit
c76763b [witgo] The default value of yarn.version is equal to hadoop.version
2014-05-03 23:32:12 -07:00
..
alpha [WIP] SPARK-1676: Cache Hadoop UGIs by default to prevent FileSystem leak 2014-05-03 10:59:05 -07:00
common/src SPARK-1588. Restore SPARK_YARN_USER_ENV and SPARK_JAVA_OPTS for YARN. 2014-04-29 12:54:02 -07:00
stable [WIP] SPARK-1676: Cache Hadoop UGIs by default to prevent FileSystem leak 2014-05-03 10:59:05 -07:00
pom.xml The default version of yarn is equal to the hadoop version 2014-05-03 23:32:12 -07:00
README.md fix docs for yarn 2014-01-03 14:14:35 +08:00

README.md

YARN DIRECTORY LAYOUT

Hadoop Yarn related codes are organized in separate directories to minimize duplicated code.

  • common : Common codes that do not depending on specific version of Hadoop.

  • alpha / stable : Codes that involve specific version of Hadoop YARN API.

alpha represents 0.23 and 2.0.x stable represents 2.2 and later, until the API changes again.

alpha / stable will build together with common dir into a single jar