ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/ec2
History
Vida Ha 94053a7b76 SPARK-2333 - spark_ec2 script should allow option for existing security group 
- Uses the name tag to identify machines in a cluster.
    - Allows overriding the security group name so it doesn't need to coincide with the cluster name.
    - Outputs the request id's of up to 10 pending spot instance requests.

Author: Vida Ha <vida@databricks.com>

Closes #1899 from vidaha/vida/ec2-reuse-security-group and squashes the following commits:

c80d5c3 [Vida Ha] wrap retries in a try catch block
b2989d5 [Vida Ha] SPARK-2333: spark_ec2 script should allow option for existing security group
2014-08-19 13:35:05 -07:00
..
deploy.generic/root/spark-ec2 EC2 configurable workers 2014-05-03 16:52:19 -07:00
third_party Added script for launching Spark on EC2 from Mesos, to make it easier 2012-06-10 23:06:15 -07:00
README Remove remaining references to incubation 2014-03-02 01:00:16 -08:00
spark-ec2 SPARK-2241: quote command line args in ec2 script 2014-06-22 20:23:49 -07:00
spark_ec2.py SPARK-2333 - spark_ec2 script should allow option for existing security group 2014-08-19 13:35:05 -07:00

README 

This folder contains a script, spark-ec2, for launching Spark clusters on
Amazon EC2. Usage instructions are available online at:

http://spark.apache.org/docs/latest/ec2-scripts.html