ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/yarn
History
Kousuke Saruta f18dd5962e [SPARK-3848] yarn alpha doesn't build on master 
yarn alpha build was broken by #2432
as it added an argument to YarnAllocator but not to yarn/alpha YarnAllocationHandler
commit 79e45c9323

Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp>

Closes #2715 from sarutak/SPARK-3848 and squashes the following commits:

bafb8d1 [Kousuke Saruta] Fixed parameters for the default constructor of alpha/YarnAllocatorHandler.
2014-10-08 11:53:43 -05:00
..
alpha [SPARK-3848] yarn alpha doesn't build on master 2014-10-08 11:53:43 -05:00
common/src [SPARK-3788] [yarn] Fix compareFs to do the right thing for HDFS namespaces. 2014-10-08 08:48:55 -05:00
stable [SPARK-3710] Fix Yarn integration tests on Hadoop 2.2. 2014-10-07 23:26:24 -07:00
pom.xml [SPARK-2778] [yarn] Add yarn integration tests. 2014-09-24 23:10:26 -07:00
README.md fix docs for yarn 2014-01-03 14:14:35 +08:00

README.md

YARN DIRECTORY LAYOUT

Hadoop Yarn related codes are organized in separate directories to minimize duplicated code.

  • common : Common codes that do not depending on specific version of Hadoop.

  • alpha / stable : Codes that involve specific version of Hadoop YARN API.

alpha represents 0.23 and 2.0.x stable represents 2.2 and later, until the API changes again.

alpha / stable will build together with common dir into a single jar