ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/ec2
History
Nicholas Chammas 317e114e11 [SPARK-3398] [SPARK-4325] [EC2] Use EC2 status checks. 
This PR re-introduces [0e648bc](0e648bc2be) from PR #2339, which somehow never made it into the codebase.

Additionally, it removes a now-unnecessary linear backoff on the SSH checks since we are blocking on EC2 status checks before testing SSH.

Author: Nicholas Chammas <nicholas.chammas@gmail.com>

Closes #3195 from nchammas/remove-ec2-ssh-backoff and squashes the following commits:

efb29e1 [Nicholas Chammas] Revert "Remove linear backoff."
ef3ca99 [Nicholas Chammas] reuse conn
adb4eaa [Nicholas Chammas] Remove linear backoff.
55caa24 [Nicholas Chammas] Check EC2 status checks before SSH.
2014-11-29 00:31:06 -08:00
..
deploy.generic/root/spark-ec2 [SPARK-787] Add S3 configuration parameters to the EC2 deploy scripts 2014-09-16 13:40:16 -07:00
third_party Added script for launching Spark on EC2 from Mesos, to make it easier 2012-06-10 23:06:15 -07:00
README Remove remaining references to incubation 2014-03-02 01:00:16 -08:00
spark-ec2 [SPARK-4137] [EC2] Don't change working dir on user 2014-11-05 20:45:35 -08:00
spark_ec2.py [SPARK-3398] [SPARK-4325] [EC2] Use EC2 status checks. 2014-11-29 00:31:06 -08:00

README 

This folder contains a script, spark-ec2, for launching Spark clusters on
Amazon EC2. Usage instructions are available online at:

http://spark.apache.org/docs/latest/ec2-scripts.html