ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/ec2
History
Michelangelo D'Agostino 86403f5525 [SPARK-5242]: Add --private-ips flag to EC2 script 
The `spark_ec2.py` script currently references the `ip_address` and `public_dns_name` attributes of an instance. On private networks, these fields aren't set, so we have problems.

This PR introduces a `--private-ips` flag that instead refers to the `private_ip_address` attribute in both cases.

Author: Michelangelo D'Agostino <mdagostino@civisanalytics.com>

Closes #5244 from mdagost/ec2_private_nets and squashes the following commits:

b684c67 [Michelangelo D'Agostino] STY: A few python lint changes.
a4a2eac [Michelangelo D'Agostino] ENH: Fix IP's typo and refactor conditional logic into functions.
c004604 [Michelangelo D'Agostino] ENH: Add --private-ips flag.
2015-04-08 16:48:45 -04:00
..
deploy.generic/root/spark-ec2 [SPARK-6402][DOC] - Remove some refererences to shark in docs and ec2 2015-03-19 08:02:06 -04:00
README Remove remaining references to incubation 2014-03-02 01:00:16 -08:00
spark-ec2 [SPARK-5434] [EC2] Preserve spaces in EC2 path 2015-01-28 12:56:03 -08:00
spark_ec2.py [SPARK-5242]: Add --private-ips flag to EC2 script 2015-04-08 16:48:45 -04:00

README 

This folder contains a script, spark-ec2, for launching Spark clusters on
Amazon EC2. Usage instructions are available online at:

http://spark.apache.org/docs/latest/ec2-scripts.html