Matei Zaharia
dc4073654b
Revert "Fix start-slave not passing instance number to spark-daemon."
...
This reverts commit a674d67c0a
2013-06-11 00:08:02 -04:00
Stephen Haberman
a674d67c0a
Fix start-slave not passing instance number to spark-daemon.
2013-05-28 16:24:19 -05:00
Josh Rosen
cda2b15041
Use ec2-metadata in start-slave.sh.
...
PR #419 applied the same change, but only to start-master.sh,
so some workers were still starting their web UI's using internal
addresses.
This should finally fix SPARK-613.
2013-05-24 13:05:06 -07:00
kalpit
aa9134f72a
spark instance number must be present in log filename to prevent multiple workers from overriding each other's logs
2013-03-26 17:49:30 -07:00
kalpit
f08db010d3
added SPARK_WORKER_INSTANCES : allows spawning multiple worker instances/processes on every slave machine
2013-03-26 17:49:30 -07:00
Shivaram Venkataraman
717b221cca
Detect whether we run on EC2 using ec2-metadata as well
2013-01-26 23:03:11 -08:00
Josh Rosen
1948f46093
Use spark-env.sh to configure standalone master. See SPARK-638.
...
Also fixed a typo in the standalone mode documentation.
2012-12-14 01:20:00 +00:00
Josh Rosen
cdaa0fad51
Use external addresses in standalone WebUI on EC2.
2012-12-01 18:19:13 -08:00
Matei Zaharia
59c0a9ad16
Use hostname instead of IP in deploy scripts to let Akka connect properly
2012-11-27 21:00:04 -08:00
Reynold Xin
f67bcbed07
Use SPARK_MASTER_IP if it is set in start-slaves.sh.
2012-10-19 01:08:23 -07:00
Matei Zaharia
30362a21e7
Update license info on deploy scripts
2012-09-25 14:43:47 -07:00
Denny
8fb955fd40
Add Apache license to non-trivial scripts taken from Hadoop.
2012-08-04 17:04:33 -07:00
Denny
c90c9ec208
Read config variables before to get the master port
2012-08-02 16:12:40 -07:00
Denny
53008c2d8a
Settings variables and bugfix for stop script.
2012-08-02 15:59:39 -07:00
Denny
0ee44c225e
Spark standalone mode cluster scripts.
...
Heavily inspired by Hadoop cluster scripts ;-)
2012-08-01 20:38:52 -07:00
