Commit graph

9 commits

Author SHA1 Message Date
Allan Douglas R. de Oliveira 4669a84ab1 EC2 configurable workers
Added option to configure number of worker instances and to set SPARK_MASTER_OPTS

Depends on: https://github.com/mesos/spark-ec2/pull/46

Author: Allan Douglas R. de Oliveira <allan@chaordicsystems.com>

Closes #612 from douglaz/ec2_configurable_workers and squashes the following commits:

d6c5d65 [Allan Douglas R. de Oliveira] Added master opts parameter
6c34671 [Allan Douglas R. de Oliveira] Use number of worker instances as string on template
ba528b9 [Allan Douglas R. de Oliveira] Added SPARK_WORKER_INSTANCES parameter
2014-05-03 16:52:19 -07:00
Patrick Wendell 6d2198643c Adding Apache license to two files 2013-09-07 20:46:58 -07:00
Patrick Wendell 5cc725a0e3 Merge branch 'master' into ec2-updates
Conflicts:
	ec2/deploy.generic/root/mesos-ec2/ec2-variables.sh
2013-07-31 21:35:12 -07:00
Ubuntu 88a0823c58 Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable (JIRA Ticket SPARK-817) 2013-07-18 00:51:18 +00:00
Patrick Wendell 311e63f2c7 Removing mesos terminology 2013-07-11 14:13:10 -07:00
Patrick Wendell eae7590d0d Support for multiple hadoop versions 2013-06-12 18:39:01 -07:00
Patrick Wendell bb328c8ff8 Re-working spark versions to use templates 2013-06-11 20:14:33 -07:00
Shivaram Venkataraman 0243b081ce Fix swap variable name 2013-01-27 00:25:29 -08:00
Shivaram Venkataraman d012cfa0e8 Update spark_ec2.py to use new spark-ec2 scripts 2013-01-26 22:48:39 -08:00