ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/bin
History
Prashant Sharma 628932b8d0 [SPARK-1776] Have Spark's SBT build read dependencies from Maven. 
Patch introduces the new way of working also retaining the existing ways of doing things.

For example build instruction for yarn in maven is
`mvn -Pyarn -PHadoop2.2 clean package -DskipTests`
in sbt it can become
`MAVEN_PROFILES="yarn, hadoop-2.2" sbt/sbt clean assembly`
Also supports
`sbt/sbt -Pyarn -Phadoop-2.2 -Dhadoop.version=2.2.0 clean assembly`

Author: Prashant Sharma <prashant.s@imaginea.com>
Author: Patrick Wendell <pwendell@gmail.com>

Closes #772 from ScrapCodes/sbt-maven and squashes the following commits:

a8ac951 [Prashant Sharma] Updated sbt version.
62b09bb [Prashant Sharma] Improvements.
fa6221d [Prashant Sharma] Excluding sql from mima
4b8875e [Prashant Sharma] Sbt assembly no longer builds tools by default.
72651ca [Prashant Sharma] Addresses code reivew comments.
acab73d [Prashant Sharma] Revert "Small fix to run-examples script."
ac4312c [Prashant Sharma] Revert "minor fix"
6af91ac [Prashant Sharma] Ported oldDeps back. + fixes issues with prev commit.
65cf06c [Prashant Sharma] Servelet API jars mess up with the other servlet jars on the class path.
446768e [Prashant Sharma] minor fix
89b9777 [Prashant Sharma] Merge conflicts
d0a02f2 [Prashant Sharma] Bumped up pom versions, Since the build now depends on pom it is better updated there. + general cleanups.
dccc8ac [Prashant Sharma] updated mima to check against 1.0
a49c61b [Prashant Sharma] Fix for tools jar
a2f5ae1 [Prashant Sharma] Fixes a bug in dependencies.
cf88758 [Prashant Sharma] cleanup
9439ea3 [Prashant Sharma] Small fix to run-examples script.
96cea1f [Prashant Sharma] SPARK-1776 Have Spark's SBT build read dependencies from Maven.
36efa62 [Patrick Wendell] Set project name in pom files and added eclipse/intellij plugins.
4973dbd [Patrick Wendell] Example build using pom reader.
2014-07-10 11:03:37 -07:00
..
compute-classpath.cmd [SPARK-1876] Windows fixes to deal with latest distribution layout changes 2014-05-19 15:02:35 -07:00
compute-classpath.sh [SPARK-2109] Setting SPARK_MEM for bin/pyspark does not work. 2014-07-03 15:06:58 -07:00
load-spark-env.sh SPARK-1404: Always upgrade spark-env.sh vars to environment vars 2014-04-04 09:50:24 -07:00
pyspark [SPARK-2109] Setting SPARK_MEM for bin/pyspark does not work. 2014-07-03 15:06:58 -07:00
pyspark.cmd moved user scripts to bin folder 2013-09-23 12:46:48 +08:00
pyspark2.cmd [SPARK-1808] Route bin/pyspark through Spark submit 2014-05-16 22:34:38 -07:00
run-example [SPARK-2109] Setting SPARK_MEM for bin/pyspark does not work. 2014-07-03 15:06:58 -07:00
run-example.cmd moved user scripts to bin folder 2013-09-23 12:46:48 +08:00
run-example2.cmd [SPARK-1876] Windows fixes to deal with latest distribution layout changes 2014-05-19 15:02:35 -07:00
spark-class [SPARK-1776] Have Spark's SBT build read dependencies from Maven. 2014-07-10 11:03:37 -07:00
spark-class.cmd sbin/spark-class* -> bin/spark-class* 2014-01-03 15:08:01 +05:30
spark-class2.cmd SPARK-1879. Increase MaxPermSize since some of our builds have many classes 2014-05-19 18:42:28 -07:00
spark-shell Fix spark-submit path in spark-shell & pyspark 2014-05-18 13:37:46 -07:00
spark-shell.cmd [SPARK-1808] Route bin/pyspark through Spark submit 2014-05-16 22:34:38 -07:00
spark-submit spark-submit: add exec at the end of the script 2014-05-24 22:39:27 -07:00
spark-submit.cmd [SPARK-1736] Spark submit for Windows 2014-05-12 17:39:40 -07:00