spark-instrumented-optimizer/sbin
Marcelo Vanzin 0b2eefb674 [SPARK-22994][K8S] Use a single image for all Spark containers.
This change allows a user to submit a Spark application on kubernetes
having to provide a single image, instead of one image for each type
of container. The image's entry point now takes an extra argument that
identifies the process that is being started.

The configuration still allows the user to provide different images
for each container type if they so desire.

On top of that, the entry point was simplified a bit to share more
code; mainly, the same env variable is used to propagate the user-defined
classpath to the different containers.

Aside from being modified to match the new behavior, the
'build-push-docker-images.sh' script was renamed to 'docker-image-tool.sh'
to more closely match its purpose; the old name was a little awkward
and now also not entirely correct, since there is a single image. It
was also moved to 'bin' since it's not necessarily an admin tool.

Docs have been updated to match the new behavior.

Tested locally with minikube.

Author: Marcelo Vanzin <vanzin@cloudera.com>

Closes #20192 from vanzin/SPARK-22994.
2018-01-11 10:37:35 -08:00
..
slaves.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
spark-config.sh [SPARK-21278][PYSPARK] Upgrade to Py4J 0.10.6 2017-07-05 16:33:23 -07:00
spark-daemon.sh [SPARK-20989][CORE] Fail to start multiple workers on one host if external shuffle service is enabled in standalone mode 2017-06-20 17:17:21 +08:00
spark-daemons.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
start-all.sh [SPARK-13521][BUILD] Remove reference to Tachyon in cluster & release scripts 2016-02-26 22:35:12 -08:00
start-history-server.sh [SPARK-19083] sbin/start-history-server.sh script use of $@ without quotes 2017-01-06 09:57:49 -08:00
start-master.sh [SPARK-17944][DEPLOY] sbin/start-* scripts use of hostname -f fail with Solaris 2016-10-22 09:37:53 +01:00
start-mesos-dispatcher.sh [SPARK-17944][DEPLOY] sbin/start-* scripts use of hostname -f fail with Solaris 2016-10-22 09:37:53 +01:00
start-mesos-shuffle-service.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
start-shuffle-service.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
start-slave.sh [SPARK-11218][CORE] show help messages for start-slave and start-master 2015-11-09 13:22:05 +01:00
start-slaves.sh [SPARK-17944][DEPLOY] sbin/start-* scripts use of hostname -f fail with Solaris 2016-10-22 09:37:53 +01:00
start-thriftserver.sh [SPARK-17598][SQL][WEB UI] User-friendly name for Spark Thrift Server in web UI 2016-10-03 10:24:30 +01:00
stop-all.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-history-server.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-master.sh [SPARK-13521][BUILD] Remove reference to Tachyon in cluster & release scripts 2016-02-26 22:35:12 -08:00
stop-mesos-dispatcher.sh [SPARK-13414][MESOS] Allow multiple dispatchers to be launched. 2016-02-20 12:58:47 -08:00
stop-mesos-shuffle-service.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-shuffle-service.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-slave.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-slaves.sh [SPARK-13521][BUILD] Remove reference to Tachyon in cluster & release scripts 2016-02-26 22:35:12 -08:00
stop-thriftserver.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00