Denny
0008994044
merged dev branch
2012-08-02 16:00:33 -07:00
Matei Zaharia
71a958b0b7
Merge branch 'dev' of github.com:mesos/spark into dev
...
Conflicts:
project/SparkBuild.scala
2012-08-02 17:23:13 -04:00
Denny
ba7e30fb5e
Mostly stlyistic changes.
2012-08-02 13:55:09 -07:00
Josh Rosen
039b41cb54
Use sbt mergeStrategy for reference.conf files.
...
Cleans up #158 / 509b721
.
2012-08-02 10:21:50 -07:00
Denny
0ee44c225e
Spark standalone mode cluster scripts.
...
Heavily inspired by Hadoop cluster scripts ;-)
2012-08-01 20:38:52 -07:00
Denny
1b29e90a79
merge dev branch
2012-08-01 14:06:09 -07:00
Denny
7a295fee96
Spark WebUI Implementation.
2012-08-01 11:01:09 -07:00
Josh Rosen
509b721d12
Fix Akka configuration in assembly jar.
...
This resolves an issue where running Spark from
the assembly jar would cause a "No configuration
setting found for key 'akka.version'" exception.
This solution is from the Akka Team Blog:
http://letitcrash.com/post/21025950392/
2012-07-30 18:05:13 -07:00
Josh Rosen
01dce3f569
Add Java API
...
Add distinct() method to RDD.
Fix bug in DoubleRDDFunctions.
2012-07-18 17:34:29 -07:00
Matei Zaharia
2fb6e7d71e
Initial framework to get a master and web UI up.
2012-06-30 14:45:55 -07:00
rrmckinley
697b0bee2c
Scalacheck groupId has changed https://github.com/rickynils/scalacheck/issues/24 . Necessary to build with scalaVersion 2.9.2. Works with 2.9.1 too.
2012-06-29 16:42:05 -07:00
Matei Zaharia
3920189932
Upgraded to Akka 2 and fixed test execution (which was still parallel
...
across projects).
2012-06-28 23:51:28 -07:00
Tathagata Das
ede615d719
Fixed issues duplicate class issues in sbt assembly.
2012-06-22 15:03:09 -07:00
Matei Zaharia
08579ffa11
Update version number for dev branch
2012-06-15 23:55:43 -07:00
Matei Zaharia
f58da6164e
Merge branch 'master' into dev
2012-06-15 23:47:11 -07:00
Matei Zaharia
4449eb9783
Changed version in master branch to 0.5.1-SNAPSHOT for further
...
development.
2012-06-13 22:26:14 -04:00
Matei Zaharia
0472cf8e0d
Update version in SBT
2012-06-12 14:30:49 -04:00
Matei Zaharia
63051dd2bc
Merge in engine improvements from the Spark Streaming project, developed
...
jointly with Tathagata Das and Haoyuan Li. This commit imports the changes
and ports them to Mesos 0.9, but does not yet pass unit tests due to
various classes not supporting a graceful stop() yet.
2012-06-07 12:45:38 -07:00
Matei Zaharia
95fb1a16b8
Use Mesos 0.9 RC3 JAR and protobuf 2.4.1
2012-03-30 11:38:49 -04:00
Matei Zaharia
4d52cc6738
Merge branch 'master' into mesos-0.9
2012-03-29 21:29:39 -04:00
Matei Zaharia
ca5c19c1ba
Remove dependency on Akka
2012-03-29 01:03:34 -04:00
Reynold Xin
90418b70ff
Added sbt-assembly for spark-repl project so we can generate an
...
assembled jar for Shark.
2012-03-22 18:46:31 -07:00
Matei Zaharia
a099a63a8a
Initial work to make Spark compile with Mesos 0.9 and Hadoop 1.0
2012-03-17 12:31:34 -07:00
Matei Zaharia
d6ec664b48
Add dependency on fastutil and update Guava
2012-02-06 15:37:27 -08:00
Matei Zaharia
5fd101d79e
Add dependency on Akka and Netty
2011-12-15 13:21:14 +01:00
Matei Zaharia
c7d6f1a65c
Really upgrade to SBT 0.11.1 (through build.properties and plugin changes)
2011-11-08 21:45:29 -08:00
root
49505a0b0b
Switched Jetty to version 7.5 because 8.0 was causing a conflict with the log4j and Jetty libraries in Hadoop.
2011-10-17 18:06:41 +00:00
Ismael Juma
7e92ef9d19
Add workaround for bug in SBT (issue #206 ).
2011-09-27 00:04:59 +01:00
Ismael Juma
3562db6374
Include "spark-" prefix in project name (used when artifact is published).
2011-09-26 22:41:07 +01:00
Ismael Juma
28b5d5a2af
Upgrade compress-lzf to 0.8.4.
2011-09-26 22:32:05 +01:00
Ismael Juma
315e55fde3
Upgrade Jetty to 8.0.1.
2011-09-26 22:32:05 +01:00
Ismael Juma
ee980439e2
Use scalatest and scalacheck compiled against Scala 2.9.1.
2011-09-26 22:32:05 +01:00
Ismael Juma
483f724d62
Upgrade to Scala 2.9.1.
...
Interestingly, the version in Maven is 2.9.1, but SBT outputs file to the 2.9.1.final
directory inside target.
A couple of small changes in SparkIMain were also required.
All tests pass and ./spark-shell launches successfully.
2011-08-31 10:43:05 +01:00
Matei Zaharia
9b7215d74a
Only include JAR files in lib in the unmanaged classpath.
2011-08-29 22:59:18 -07:00
Matei Zaharia
4cc5e51e28
Use the new SBT 0.10 assembly plugin instead of the DepJar code we had.
2011-08-29 16:13:26 -07:00
Ismael Juma
2b6fd3198d
Fix issue #69 : Enable -optimize in the build
2011-08-02 10:34:41 +01:00
Ismael Juma
59c7131dff
Add note about why we can't enable -deprecation switch.
2011-08-02 10:26:17 +01:00
Matei Zaharia
2e57338896
Merge branch 'scala-2.9'
2011-08-01 15:27:08 -07:00
Matei Zaharia
711575391d
Merge branch 'scala-2.9'
...
Conflicts:
project/build/SparkProject.scala
2011-08-01 15:25:26 -07:00
Ismael Juma
3f5d7b5d11
Add publishTo configuration that publishes to target directory.
...
Until Spark is available in a Maven repository, this makes it easy to deploy to
e.g. GitHub pages by copying target/maven to the repository.
2011-07-31 20:17:58 +01:00
Ismael Juma
fc0a2c8db8
Add and configure junit_xml_listener as a replacement for XmlTestReport.
2011-07-21 01:04:29 +01:00
Ismael Juma
51673ca62e
Introduce DepJarPlugin based on AssemblyPlugin and use it in SparkBuild.
2011-07-18 10:34:51 +01:00
Ismael Juma
8531c2a079
Update test dependencies.
2011-07-18 00:16:08 +01:00
Ismael Juma
635f501492
Fix copy & paste error in version.
2011-07-18 00:13:37 +01:00
Ismael Juma
f686e3dacb
Initial work on converting build to SBT 0.10.1
2011-07-15 03:38:30 +01:00