spark-instrumented-optimizer/yarn
Tianshuo Deng 181b130a0c [bugfix] wrong client arg, should use executor-cores
client arg is wrong, it should be executor-cores. it causes executor fail to start when executor-cores is specified

Author: Tianshuo Deng <tdeng@twitter.com>

Closes #138 from tsdeng/bugfix_wrong_client_args and squashes the following commits:

304826d [Tianshuo Deng] wrong client arg, should use executor-cores
2014-03-13 20:27:36 -07:00
..
alpha SPARK-1183. Don't use "worker" to mean executor 2014-03-13 12:11:33 -07:00
common/src [bugfix] wrong client arg, should use executor-cores 2014-03-13 20:27:36 -07:00
stable SPARK-1183. Don't use "worker" to mean executor 2014-03-13 12:11:33 -07:00
pom.xml SPARK-1121: Include avro for yarn-alpha builds 2014-03-02 15:18:19 -08:00
README.md fix docs for yarn 2014-01-03 14:14:35 +08:00

YARN DIRECTORY LAYOUT

Hadoop Yarn related codes are organized in separate directories to minimize duplicated code.

  • common : Common codes that do not depending on specific version of Hadoop.

  • alpha / stable : Codes that involve specific version of Hadoop YARN API.

alpha represents 0.23 and 2.0.x stable represents 2.2 and later, until the API changes again.

alpha / stable will build together with common dir into a single jar