Commit graph

170 commits

Author SHA1 Message Date
Matei Zaharia 597520ae20 Make sure the SSH key we copy to EC2 has permissions 600.
SPARK-539 #resolve
2012-12-10 15:12:06 -08:00
Matei Zaharia cd16eab0db Merge pull request #309 from admobius/use-boto-config-file
Improved use of Boto
2012-11-19 15:51:41 -08:00
Peter Sankauskas dc2fb3c4b6 Allow Boto to use the other config options it supports, and gracefully
handling Boto connection exceptions (like AuthFailure)
2012-11-19 14:21:16 -08:00
Matei Zaharia 85ce5f27c1 Merge pull request #308 from admobius/multi-zone
Let EC2 script launch slaves in multiple availability zones
2012-11-19 13:24:09 -08:00
Peter Sankauskas 606d252d26 Adding comment about additional bandwidth charges 2012-11-17 23:09:11 -08:00
Peter Sankauskas 32442ee1e1 Giving the Spark EC2 script the ability to launch instances spread
across multiple availability zones in order to make the cluster more
resilient to failure
2012-11-16 17:25:28 -08:00
Peter Sankauskas 6d22f7ccb8 Delete security groups when deleting the cluster. As many operations
are done on instances in specific security groups, this seems like a
reasonable thing to clean up.
2012-11-16 14:02:43 -08:00
Josh Rosen 594eed31c4 Fix check for existing instances during EC2 launch. 2012-11-03 17:02:47 -07:00
Josh Rosen 96c9bcfd8d Cancel spot instance requests when exiting spark-ec2. 2012-10-30 23:32:38 -07:00
Josh Rosen 365a4c1e68 Allow EC2 script to stop/destroy cluster after master/slave failures. 2012-10-18 10:36:50 -07:00
Matei Zaharia 5b7ee173e1 Update EC2 scripts for Spark 0.6 2012-10-12 19:53:03 -07:00
Ray Racine c52bd1b6b1 Add m1.medium node option to cluster management script. 2012-10-09 11:05:13 -04:00
Matei Zaharia 47507d69d9 Made region used by spark-ec2 configurable. 2012-08-28 22:40:00 -07:00
Denny 8dc7242544 Use root login in standalone AMI 2012-08-14 10:18:24 -07:00
Denny 7152c7c12d rsync root directory in EC2 script 2012-08-14 09:26:47 -07:00
Matei Zaharia 8069bd5b41 Removed separate launcher for EC2 standalone cluster 2012-08-09 22:45:24 +02:00
Denny aaed039e36 Merged standalone and mesos EC2 scripts 2012-08-02 15:23:52 -07:00
Denny 0ee44c225e Spark standalone mode cluster scripts.
Heavily inspired by Hadoop cluster scripts ;-)
2012-08-01 20:38:52 -07:00
Matei Zaharia 8a5bd4e765 Increase the default wait time for EC2 clusters to 2 minutes. 2012-06-29 16:25:40 -07:00
Matei Zaharia 08c50ad1fc Added script for launching Spark on EC2 from Mesos, to make it easier
for new users to get up and running on EC2.
2012-06-10 23:06:15 -07:00