Matei Zaharia
2ab311f4ce
Removed second version of junit test plugin from plugins.sbt
2013-06-18 00:40:25 +02:00
Christopher Nguyen
479442a9b9
Add zeroLengthPartitions() test to make sure, e.g., StatCounter.scala can handle empty partitions without incorrectly returning NaN
2013-06-15 17:35:55 -07:00
Reynold Xin
f742435f18
Removed the duplicated netty dependency in SBT build file.
2013-05-16 14:31:03 -07:00
Reynold Xin
f3491cb89b
Merge branch 'master' of github.com:mesos/spark into shufflemerge
...
Conflicts:
core/src/main/scala/spark/storage/BlockManager.scala
core/src/test/scala/spark/DistributedSuite.scala
project/SparkBuild.scala
2013-05-15 00:31:52 -07:00
Reynold Xin
81ad2fa331
Merge branch 'jdbc' of github.com:koeninger/spark
...
Conflicts:
project/SparkBuild.scala
2013-05-14 23:12:00 -07:00
Cody Koeninger
b16c4896f6
add test for JdbcRDD using embedded derby, per rxin suggestion
2013-05-14 23:44:04 -05:00
Reynold Xin
90577ada69
Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark into shufflemerge
...
Conflicts:
core/src/main/scala/spark/storage/BlockManager.scala
core/src/main/scala/spark/storage/DiskStore.scala
project/SparkBuild.scala
2013-05-07 15:56:19 -07:00
Jey Kottalam
207afe4088
Remove spark-repl's extraneous dependency on spark-streaming
2013-05-01 16:57:31 -07:00
Matei Zaharia
f1f92c88eb
Build against Hadoop 1 by default
2013-04-29 17:08:45 -07:00
Matei Zaharia
1b169f190c
Exclude old versions of Netty, which had a different Maven organization
2013-04-25 19:52:12 -07:00
Matei Zaharia
eef9ea1993
Update unit test memory to 2 GB
2013-04-25 00:42:29 -07:00
Matei Zaharia
01d9ba5038
Add back line removed during YARN merge
2013-04-25 00:11:27 -07:00
Mridul Muralidharan
3b594a4e3b
Do not add signature files - results in validation errors when using assembled file
2013-04-24 10:18:25 +05:30
Mridul Muralidharan
dd515ca3ee
Attempt at fixing merge conflict
2013-04-24 09:24:17 +05:30
Mridul Muralidharan
adcda84f96
Pull latest SparkBuild.scala from master and merge conflicts
2013-04-24 08:57:25 +05:30
Mridul Muralidharan
5b85c715c8
Revert back to 2.0.2-alpha : 0.23.7 has protocol changes which break against cloudera
2013-04-24 02:57:51 +05:30
Mridul Muralidharan
8faf5c51c3
Patch from Thomas Graves to improve the YARN Client, and move to more production ready hadoop yarn branch
2013-04-24 02:31:57 +05:30
Mridul Muralidharan
7acab3ab45
Fix review comments, add a new api to SparkHadoopUtil to create appropriate Configuration. Modify an example to show how to use SplitInfo
2013-04-22 08:01:13 +05:30
Matei Zaharia
17e076de80
Turn on forking in test JVMs to reduce the pressure on perm gen and code
...
cache sizes due to having 2 instances of the Scala compiler and a bunch
of classloaders.
2013-04-18 22:25:57 -07:00
Mridul Muralidharan
5d891534fd
Move back to 2.0.2-alpha, since 2.0.3-alpha is not available in cloudera yet. Also, add netty dependency explicitly to prevent resolving to older 2.3x version. Additionally, comment out retrievePattern to ensure correct netty is picked up
2013-04-17 05:54:43 +05:30
Matei Zaharia
ec5e553b41
Merge pull request #558 from ash211/patch-jackson-conflict
...
Don't pull in old versions of Jackson via hadoop-core
2013-04-14 08:20:13 -07:00
Matei Zaharia
ed336e0d44
Fix tests from different projects running in parallel in SBT 0.12
2013-04-11 22:29:37 -04:00
Andrew Ash
18bd41d1a3
Don't pull in old versions of Jackson via hadoop-core
2013-04-09 14:44:47 -04:00
Matei Zaharia
65caa8f711
Merge remote-tracking branch 'jey/bump-development-version-to-0.8.0'
...
Conflicts:
docs/_config.yml
project/SparkBuild.scala
2013-04-08 12:43:17 -04:00
Matei Zaharia
1cb3eb9762
Merge remote-tracking branch 'kalpit/master'
...
Conflicts:
project/SparkBuild.scala
2013-04-07 20:54:18 -04:00
Matei Zaharia
b362df39ea
Merge pull request #552 from MLnick/master
...
Bumping version for Twitter Algebird to latest
2013-04-07 17:17:52 -07:00
Mridul Muralidharan
6798a09df8
Add support for building against hadoop2-yarn : adding new maven profile for it
2013-04-07 17:47:38 +05:30
shane-huang
df47b40b76
Shuffle Performance fix: Use netty embeded OIO file server instead of ConnectionManager
...
Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages
change reference from io.Source to scala.io.Source to avoid looking into io.netty package
Signed-off-by: shane-huang <shengsheng.huang@intel.com>
2013-04-07 14:37:12 +08:00
Andy Konwinski
5555811bd5
Update build to Scala 2.9.3
2013-04-04 13:26:45 -07:00
Nick Pentreath
0f54344fd8
Bumping Algebird version in examples now that it supports JDK 1.6
2013-04-03 13:15:34 +02:00
Jey Kottalam
bc8ba222ff
Bump development version to 0.8.0
2013-03-28 15:42:01 -07:00
kalpit
f0164e5047
upgraded sbt version, sbt plugins and some library dependencies to latest stable version
2013-03-26 17:49:29 -07:00
Holden Karau
8456d673e2
Re-enable deprecation warnings since there are only two
2013-03-24 17:30:23 -07:00
Holden Karau
e104a76016
Makes the syntax highlighting on the build file not broken in emacs.
2013-03-24 16:16:05 -07:00
Hiral Patel
664e5fd24b
Fix reference bug in Kryo serializer, add test, update version
2013-03-07 22:16:11 -08:00
Matei Zaharia
db9b90fdbd
Change version to 0.7.1-SNAPSHOT for development branch
2013-02-27 09:15:26 -08:00
Matei Zaharia
7e67c626ee
Change version number to 0.7.0
2013-02-25 20:30:47 -08:00
Matei Zaharia
6494cab19d
Update Hadoop dependency to 1.0.4
2013-02-25 15:38:21 -08:00
Prashant Sharma
254acb1666
Moving akka dependency resolver to shared.
2013-02-25 13:37:07 +05:30
Tathagata Das
5ab37be983
Fixed class paths and dependencies based on Matei's comments.
2013-02-24 16:24:52 -08:00
Tathagata Das
f282bc4960
Changed Algebird from 0.1.9 to 0.1.8
2013-02-24 12:44:12 -08:00
Tathagata Das
24c0cd6168
Fixed resolver for akka-zeromq
2013-02-22 18:23:29 -08:00
Tathagata Das
cfa65ebff1
Merge pull request #480 from MLnick/streaming-eg-algebird
...
[Streaming] Examples using Twitter's Algebird library
2013-02-22 12:29:04 -08:00
Nick Pentreath
718474b9c6
Bumping Algebird to 0.1.9
2013-02-21 12:11:31 +02:00
Prashant Sharma
4e5b09664c
fixes corresponding to review feedback at pull request #479
2013-02-20 19:14:52 +05:30
Prashant Sharma
f7d3e309cb
ZeroMQ stream as receiver
2013-02-19 19:32:52 +05:30
Nick Pentreath
315ea069e8
Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird
...
Conflicts:
project/SparkBuild.scala
2013-02-19 13:58:05 +02:00
Nick Pentreath
015893f0e8
Adding streaming HyperLogLog example using Algebird
2013-02-19 13:21:33 +02:00
Tathagata Das
def8126d77
Added TwitterInputDStream from example to StreamingContext. Renamed example TwitterBasic to TwitterPopularTags.
2013-02-14 17:49:43 -08:00
Charles Reiss
0f81025eca
Add easymock to SBT configuration.
2013-01-29 18:55:42 -08:00
