ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/docker/spark-test
History
yongtang 5c41691fe4 [SPARK-8954] [BUILD] Remove unneeded deb repository from Dockerfile to fix build error in docker. 
[SPARK-8954] [Build]
1. Remove unneeded deb repository from Dockerfile to fix build error in docker.
2. Remove unneeded /var/lib/apt/lists/* after install to reduce the docker image size (by ~30MB).

Author: yongtang <yongtang@users.noreply.github.com>

Closes #7346 from yongtang/SPARK-8954 and squashes the following commits:

36024a1 [yongtang] [SPARK-8954] [Build] Remove unneeded /var/lib/apt/lists/* after install to reduce the docker image size (by ~30MB)
7084941 [yongtang] [SPARK-8954] [Build] Remove unneeded deb repository from Dockerfile to fix build error in docker.
2015-07-13 12:01:23 -07:00
..
base [SPARK-8954] [BUILD] Remove unneeded deb repository from Dockerfile to fix build error in docker. 2015-07-13 12:01:23 -07:00
master SPARK-1136: Fix FaultToleranceTest for Docker 0.8.1 2014-03-07 10:22:27 -08:00
worker SPARK-1136: Fix FaultToleranceTest for Docker 0.8.1 2014-03-07 10:22:27 -08:00
build Add license agreements to dockerfiles 2013-10-08 11:41:12 -07:00
README.md A little revise for the document 2013-10-29 00:28:56 +08:00

README.md

Spark Docker files usable for testing and development purposes.

These images are intended to be run like so:

docker run -v $SPARK_HOME:/opt/spark spark-test-master
docker run -v $SPARK_HOME:/opt/spark spark-test-worker spark://<master_ip>:7077

Using this configuration, the containers will have their Spark directories mounted to your actual SPARK_HOME, allowing you to modify and recompile your Spark source and have them immediately usable in the docker images (without rebuilding them).