Reynold Xin
|
f54bc544c5
|
Merge branch 'master' of github.com:mesos/spark into graph
|
2013-05-02 17:25:09 -07:00 |
|
Jey Kottalam
|
207afe4088
|
Remove spark-repl's extraneous dependency on spark-streaming
|
2013-05-01 16:57:31 -07:00 |
|
Matei Zaharia
|
f1f92c88eb
|
Build against Hadoop 1 by default
|
2013-04-29 17:08:45 -07:00 |
|
Matei Zaharia
|
1b169f190c
|
Exclude old versions of Netty, which had a different Maven organization
|
2013-04-25 19:52:12 -07:00 |
|
Matei Zaharia
|
eef9ea1993
|
Update unit test memory to 2 GB
|
2013-04-25 00:42:29 -07:00 |
|
Matei Zaharia
|
01d9ba5038
|
Add back line removed during YARN merge
|
2013-04-25 00:11:27 -07:00 |
|
Mridul Muralidharan
|
3b594a4e3b
|
Do not add signature files - results in validation errors when using assembled file
|
2013-04-24 10:18:25 +05:30 |
|
Mridul Muralidharan
|
adcda84f96
|
Pull latest SparkBuild.scala from master and merge conflicts
|
2013-04-24 08:57:25 +05:30 |
|
Mridul Muralidharan
|
5b85c715c8
|
Revert back to 2.0.2-alpha : 0.23.7 has protocol changes which break against cloudera
|
2013-04-24 02:57:51 +05:30 |
|
Mridul Muralidharan
|
8faf5c51c3
|
Patch from Thomas Graves to improve the YARN Client, and move to more production ready hadoop yarn branch
|
2013-04-24 02:31:57 +05:30 |
|
Mridul Muralidharan
|
7acab3ab45
|
Fix review comments, add a new api to SparkHadoopUtil to create appropriate Configuration. Modify an example to show how to use SplitInfo
|
2013-04-22 08:01:13 +05:30 |
|
Mridul Muralidharan
|
5d891534fd
|
Move back to 2.0.2-alpha, since 2.0.3-alpha is not available in cloudera yet. Also, add netty dependency explicitly to prevent resolving to older 2.3x version. Additionally, comment out retrievePattern to ensure correct netty is picked up
|
2013-04-17 05:54:43 +05:30 |
|
Mridul Muralidharan
|
6798a09df8
|
Add support for building against hadoop2-yarn : adding new maven profile for it
|
2013-04-07 17:47:38 +05:30 |
|
Reynold Xin
|
3728e1bc40
|
Code to run bagel vs graph experiments.
|
2013-04-07 15:05:46 +08:00 |
|
Reynold Xin
|
f130eb624c
|
Merge branch 'master' of github.com:mesos/spark into graph
|
2013-04-01 20:06:30 +08:00 |
|
Holden Karau
|
8456d673e2
|
Re-enable deprecation warnings since there are only two
|
2013-03-24 17:30:23 -07:00 |
|
Holden Karau
|
e104a76016
|
Makes the syntax highlighting on the build file not broken in emacs.
|
2013-03-24 16:16:05 -07:00 |
|
Reynold Xin
|
ba9d00c44a
|
Merge branch 'master' into graph
Conflicts:
run2.cmd
|
2013-03-18 18:30:14 +08:00 |
|
Hiral Patel
|
664e5fd24b
|
Fix reference bug in Kryo serializer, add test, update version
|
2013-03-07 22:16:11 -08:00 |
|
Matei Zaharia
|
db9b90fdbd
|
Change version to 0.7.1-SNAPSHOT for development branch
|
2013-02-27 09:15:26 -08:00 |
|
Matei Zaharia
|
7e67c626ee
|
Change version number to 0.7.0
|
2013-02-25 20:30:47 -08:00 |
|
Matei Zaharia
|
6494cab19d
|
Update Hadoop dependency to 1.0.4
|
2013-02-25 15:38:21 -08:00 |
|
Prashant Sharma
|
254acb1666
|
Moving akka dependency resolver to shared.
|
2013-02-25 13:37:07 +05:30 |
|
Tathagata Das
|
5ab37be983
|
Fixed class paths and dependencies based on Matei's comments.
|
2013-02-24 16:24:52 -08:00 |
|
Tathagata Das
|
f282bc4960
|
Changed Algebird from 0.1.9 to 0.1.8
|
2013-02-24 12:44:12 -08:00 |
|
Tathagata Das
|
24c0cd6168
|
Fixed resolver for akka-zeromq
|
2013-02-22 18:23:29 -08:00 |
|
Tathagata Das
|
cfa65ebff1
|
Merge pull request #480 from MLnick/streaming-eg-algebird
[Streaming] Examples using Twitter's Algebird library
|
2013-02-22 12:29:04 -08:00 |
|
Nick Pentreath
|
718474b9c6
|
Bumping Algebird to 0.1.9
|
2013-02-21 12:11:31 +02:00 |
|
Prashant Sharma
|
4e5b09664c
|
fixes corresponding to review feedback at pull request #479
|
2013-02-20 19:14:52 +05:30 |
|
Reynold Xin
|
19d3b059e3
|
Merge branch 'master' into graph
|
2013-02-19 12:44:05 -08:00 |
|
Reynold Xin
|
81c4d19c61
|
Maven and sbt build changes for SparkGraph.
|
2013-02-19 12:43:13 -08:00 |
|
Prashant Sharma
|
f7d3e309cb
|
ZeroMQ stream as receiver
|
2013-02-19 19:32:52 +05:30 |
|
Nick Pentreath
|
315ea069e8
|
Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird
Conflicts:
project/SparkBuild.scala
|
2013-02-19 13:58:05 +02:00 |
|
Nick Pentreath
|
015893f0e8
|
Adding streaming HyperLogLog example using Algebird
|
2013-02-19 13:21:33 +02:00 |
|
Tathagata Das
|
def8126d77
|
Added TwitterInputDStream from example to StreamingContext. Renamed example TwitterBasic to TwitterPopularTags.
|
2013-02-14 17:49:43 -08:00 |
|
Charles Reiss
|
0f81025eca
|
Add easymock to SBT configuration.
|
2013-01-29 18:55:42 -08:00 |
|
Matei Zaharia
|
6e3754bf47
|
Add Maven build file for streaming, and fix some issues in SBT file
As part of this, changed our Scala 2.9.2 Kafka library to be available
as a local Maven repository, following the example in
(http://blog.dub.podval.org/2010/01/maven-in-project-repository.html)
|
2013-01-20 19:22:24 -08:00 |
|
Tathagata Das
|
cd1521cfdb
|
Merge branch 'master' into streaming
Conflicts:
core/src/main/scala/spark/rdd/CoGroupedRDD.scala
core/src/main/scala/spark/rdd/FilteredRDD.scala
docs/_layouts/global.html
docs/index.md
run
|
2013-01-15 12:08:51 -08:00 |
|
Matei Zaharia
|
6d1c230281
|
Merge pull request #357 from tysonjh/master
JSON support added to WebUI
|
2013-01-10 19:06:07 -08:00 |
|
Tyson
|
549ee388a1
|
Removed io.spray spray-json dependency as it is not needed.
|
2013-01-09 15:12:23 -05:00 |
|
Tyson
|
6e8c8f61c4
|
Added the spray implicit marshaller library
Added the io.spray JSON library
|
2013-01-09 10:40:33 -05:00 |
|
Stephen Haberman
|
c3f1675f9c
|
Retrieve jars to a flat directory so * can be used for the classpath.
|
2013-01-08 14:44:33 -06:00 |
|
Tathagata Das
|
64dceec293
|
Merge branch 'streaming-merge' into dev-merge
|
2013-01-07 16:54:35 -08:00 |
|
Shivaram Venkataraman
|
aed368a970
|
Update Hadoop dependency to 1.0.3 as 0.20 has Sun specific dependencies. Also
fix SequenceFileRDDFunctions to pick the right type conversion across Hadoop
versions
|
2013-01-07 15:57:33 -08:00 |
|
Tathagata Das
|
af8738dfb5
|
Moved Spark Streaming examples to examples sub-project.
|
2013-01-06 19:31:54 -08:00 |
|
Patrick Wendell
|
518111573f
|
Merge pull request #8 from radlab/twitter-example
Adding a Twitter InputDStream with an example
|
2012-12-29 14:23:01 -08:00 |
|
Tathagata Das
|
7c33f76291
|
Merge branch 'mesos' into dev-merge
|
2012-12-26 19:19:07 -08:00 |
|
Patrick Wendell
|
9ac4cb1c5f
|
Adding a Twitter InputDStream with an example
|
2012-12-21 17:18:19 -08:00 |
|
Matei Zaharia
|
3334b7c6b5
|
Merge pull request #341 from rxin/4a3fb06ac2d11125feb08acbbd4df76d1e91b677
Kryo2 update against Spark master
|
2012-12-21 15:31:23 -08:00 |
|
Reynold Xin
|
eac566a7f4
|
Merge branch 'master' of github.com:mesos/spark into dev
Conflicts:
core/src/main/scala/spark/MapOutputTracker.scala
core/src/main/scala/spark/PairRDDFunctions.scala
core/src/main/scala/spark/ParallelCollection.scala
core/src/main/scala/spark/RDD.scala
core/src/main/scala/spark/rdd/BlockRDD.scala
core/src/main/scala/spark/rdd/CartesianRDD.scala
core/src/main/scala/spark/rdd/CoGroupedRDD.scala
core/src/main/scala/spark/rdd/CoalescedRDD.scala
core/src/main/scala/spark/rdd/FilteredRDD.scala
core/src/main/scala/spark/rdd/FlatMappedRDD.scala
core/src/main/scala/spark/rdd/GlommedRDD.scala
core/src/main/scala/spark/rdd/HadoopRDD.scala
core/src/main/scala/spark/rdd/MapPartitionsRDD.scala
core/src/main/scala/spark/rdd/MapPartitionsWithSplitRDD.scala
core/src/main/scala/spark/rdd/MappedRDD.scala
core/src/main/scala/spark/rdd/PipedRDD.scala
core/src/main/scala/spark/rdd/SampledRDD.scala
core/src/main/scala/spark/rdd/ShuffledRDD.scala
core/src/main/scala/spark/rdd/UnionRDD.scala
core/src/main/scala/spark/storage/BlockManager.scala
core/src/main/scala/spark/storage/BlockManagerId.scala
core/src/main/scala/spark/storage/BlockManagerMaster.scala
core/src/main/scala/spark/storage/StorageLevel.scala
core/src/main/scala/spark/util/MetadataCleaner.scala
core/src/main/scala/spark/util/TimeStampedHashMap.scala
core/src/test/scala/spark/storage/BlockManagerSuite.scala
run
|
2012-12-20 14:53:40 -08:00 |
|