spark-instrumented-optimizer/docker/spark-test/README.md

12 lines
497 B
Markdown
Raw Normal View History

Spark Docker files usable for testing and development purposes.
These images are intended to be run like so:
2013-10-26 03:13:57 -04:00
docker run -v $SPARK_HOME:/opt/spark spark-test-master
2013-10-28 12:28:56 -04:00
docker run -v $SPARK_HOME:/opt/spark spark-test-worker spark://<master_ip>:7077
Using this configuration, the containers will have their Spark directories
2013-10-26 03:13:57 -04:00
mounted to your actual `SPARK_HOME`, allowing you to modify and recompile
your Spark source and have them immediately usable in the docker images
(without rebuilding them).