ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/docker/spark-test/README.md
Aaron Davidson e1190229e1 Add end-to-end test for standalone scheduler fault tolerance 
Docker files drawn mostly from Matt Masse. Some updates from Andre Schumacher.
2013-10-05 23:20:31 -07:00

479 B
Raw Blame History

Spark Docker files usable for testing and development purposes.

These images are intended to be run like so: docker run -v $SPARK_HOME:/opt/spark spark-test-master docker run -v $SPARK_HOME:/opt/spark spark-test-worker <master_ip>

Using this configuration, the containers will have their Spark directories mounted to your actual SPARK_HOME, allowing you to modify and recompile your Spark source and have them immediately usable in the docker images (without rebuilding them).