ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/docker/spark-test
History
CodingCat 1aa4f8af72 [SPARK-1055] fix the SCALA_VERSION and SPARK_VERSION in docker file 
As reported in https://spark-project.atlassian.net/browse/SPARK-1055

"The used Spark version in the .../base/Dockerfile is stale on 0.8.1 and should be updated to 0.9.x to match the release."

Author: CodingCat <zhunansjtu@gmail.com>
Author: Nan Zhu <CodingCat@users.noreply.github.com>

Closes #634 from CodingCat/SPARK-1055 and squashes the following commits:

cb7330e [Nan Zhu] Update Dockerfile
adf8259 [CodingCat] fix the SCALA_VERSION and SPARK_VERSION in docker file
2014-02-22 15:39:25 -08:00
..
base [SPARK-1055] fix the SCALA_VERSION and SPARK_VERSION in docker file 2014-02-22 15:39:25 -08:00
master Add license agreements to dockerfiles 2013-10-08 11:41:12 -07:00
worker Add license agreements to dockerfiles 2013-10-08 11:41:12 -07:00
build Add license agreements to dockerfiles 2013-10-08 11:41:12 -07:00
README.md A little revise for the document 2013-10-29 00:28:56 +08:00

README.md

Spark Docker files usable for testing and development purposes.

These images are intended to be run like so:

docker run -v $SPARK_HOME:/opt/spark spark-test-master
docker run -v $SPARK_HOME:/opt/spark spark-test-worker spark://<master_ip>:7077

Using this configuration, the containers will have their Spark directories mounted to your actual SPARK_HOME, allowing you to modify and recompile your Spark source and have them immediately usable in the docker images (without rebuilding them).