Tathagata Das
|
f282bc4960
|
Changed Algebird from 0.1.9 to 0.1.8
|
2013-02-24 12:44:12 -08:00 |
|
Tathagata Das
|
c1a040db3a
|
Fixed bugs in examples.
|
2013-02-24 11:00:30 -08:00 |
|
Tathagata Das
|
41285eaae3
|
Fixed differences in APIs of StreamingContext and JavaStreamingContext. Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite.
|
2013-02-23 16:25:07 -08:00 |
|
Tathagata Das
|
cfa65ebff1
|
Merge pull request #480 from MLnick/streaming-eg-algebird
[Streaming] Examples using Twitter's Algebird library
|
2013-02-22 12:29:04 -08:00 |
|
Tathagata Das
|
688e62718f
|
Merge pull request #479 from ScrapCodes/zeromq-streaming
Zeromq streaming
|
2013-02-22 12:17:17 -08:00 |
|
Nick Pentreath
|
d9bdae8cc2
|
Adding documentation for HLL and CMS examples. More efficient and clear use of the monoids.
|
2013-02-21 12:31:31 +02:00 |
|
Nick Pentreath
|
718474b9c6
|
Bumping Algebird to 0.1.9
|
2013-02-21 12:11:31 +02:00 |
|
Nick Pentreath
|
16d456742e
|
Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird
|
2013-02-21 09:33:08 +02:00 |
|
Tathagata Das
|
972fe7714f
|
Merge branch 'mesos-streaming' into streaming
Conflicts:
streaming/src/test/java/spark/streaming/JavaAPISuite.java
|
2013-02-20 11:06:01 -08:00 |
|
Tathagata Das
|
fb9956256d
|
Merge branch 'mesos-master' into streaming
Conflicts:
core/src/main/scala/spark/rdd/CheckpointRDD.scala
streaming/src/main/scala/spark/streaming/dstream/ReducedWindowedDStream.scala
|
2013-02-20 09:01:29 -08:00 |
|
Prashant Sharma
|
4e5b09664c
|
fixes corresponding to review feedback at pull request #479
|
2013-02-20 19:14:52 +05:30 |
|
Prashant Sharma
|
05dc385649
|
A bug fix post merge, following changes to AkkaUtils
|
2013-02-20 15:28:12 +05:30 |
|
Nick Pentreath
|
8a281399f9
|
Streaming example using Twitter Algebird's Count Min Sketch monoid
|
2013-02-19 17:56:02 +02:00 |
|
Nick Pentreath
|
d8ee184d95
|
Dependencies and refactoring for streaming HLL example, and using context.twitterStream method
|
2013-02-19 17:42:57 +02:00 |
|
Prashant Sharma
|
8d44480d84
|
example for demonstrating ZeroMQ stream
|
2013-02-19 19:42:14 +05:30 |
|
Nick Pentreath
|
315ea069e8
|
Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird
Conflicts:
project/SparkBuild.scala
|
2013-02-19 13:58:05 +02:00 |
|
Nick Pentreath
|
015893f0e8
|
Adding streaming HyperLogLog example using Algebird
|
2013-02-19 13:21:33 +02:00 |
|
Tathagata Das
|
7e30c46aaf
|
Added comment to the KafkaWordCount, given by Sean McNamara.
|
2013-02-19 03:05:44 -08:00 |
|
Tathagata Das
|
9e82be1503
|
Merge branch 'streaming' into ScrapCodes-streaming-actor
Conflicts:
docs/plugin-custom-receiver.md
streaming/src/main/scala/spark/streaming/StreamingContext.scala
streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala
streaming/src/main/scala/spark/streaming/dstream/PluggableInputDStream.scala
streaming/src/main/scala/spark/streaming/receivers/ActorReceiver.scala
streaming/src/test/scala/spark/streaming/InputStreamsSuite.scala
|
2013-02-19 02:48:50 -08:00 |
|
Tathagata Das
|
12ea14c211
|
Changed networkStream to socketStream and pluggableNetworkStream to become networkStream as a way to create streams from arbitrary network receiver.
|
2013-02-18 15:18:34 -08:00 |
|
Tathagata Das
|
6a6e6bda57
|
Merge branch 'streaming' into ScrapCode-streaming
Conflicts:
streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala
streaming/src/main/scala/spark/streaming/dstream/NetworkInputDStream.scala
|
2013-02-18 13:26:12 -08:00 |
|
Tathagata Das
|
4b8402e900
|
Moved Java streaming examples to examples/src/main/java/spark/streaming/... and fixed logging in NetworkInputTracker to highlight errors when receiver deregisters/shuts down.
|
2013-02-14 18:10:37 -08:00 |
|
Tathagata Das
|
def8126d77
|
Added TwitterInputDStream from example to StreamingContext. Renamed example TwitterBasic to TwitterPopularTags.
|
2013-02-14 17:49:43 -08:00 |
|
Tathagata Das
|
2eacf22401
|
Removed countByKeyAndWindow on paired DStreams, and added countByValueAndWindow for all DStreams. Updated both scala and java API and testsuites.
|
2013-02-14 12:21:47 -08:00 |
|
Prashant Sharma
|
291dd47c7f
|
Taking FeederActor out as seperate program
|
2013-02-08 14:34:07 +05:30 |
|
Tathagata Das
|
4cc223b478
|
Merge branch 'mesos-master' into streaming
|
2013-02-07 13:59:31 -08:00 |
|
Tathagata Das
|
12300758cc
|
Merge pull request #372 from Reinvigorate/sm-kafka
Removing offset management code that is non-existent in kafka 0.7.0+
|
2013-02-07 12:41:07 -08:00 |
|
Patrick Wendell
|
dab81a8511
|
Fixing to match Spark styleguide
|
2013-02-05 20:57:04 -08:00 |
|
Patrick Wendell
|
cc37601ecb
|
Adding an example with an OLAP roll-up
|
2013-02-04 14:18:11 -08:00 |
|
Mikhail Bautin
|
fe3eceab57
|
Remove activation of profiles by default
See the discussion at https://github.com/mesos/spark/pull/355 for why
default profile activation is a problem.
|
2013-01-31 13:30:41 -08:00 |
|
Prashant Sharma
|
4496bf197b
|
Improved document comment in example
|
2013-01-25 14:34:38 +05:30 |
|
Prashant Sharma
|
d17065c4b5
|
actor as receiver
|
2013-01-22 13:28:29 +05:30 |
|
Prashant Sharma
|
43bfd7bb21
|
Changed method name of createReceiver to getReceiver as it is not intended to be a factory.
|
2013-01-21 11:39:30 +05:30 |
|
Matei Zaharia
|
6e3754bf47
|
Add Maven build file for streaming, and fix some issues in SBT file
As part of this, changed our Scala 2.9.2 Kafka library to be available
as a local Maven repository, following the example in
(http://blog.dub.podval.org/2010/01/maven-in-project-repository.html)
|
2013-01-20 19:22:24 -08:00 |
|
Matei Zaharia
|
86057ec7c8
|
Merge branch 'master' into streaming
Conflicts:
core/src/main/scala/spark/api/python/PythonRDD.scala
|
2013-01-20 12:47:55 -08:00 |
|
Matei Zaharia
|
2a8c2a6790
|
Minor formatting fixes
|
2013-01-20 10:24:53 -08:00 |
|
Tathagata Das
|
4f8fe58b25
|
Merge branch 'mesos-streaming' into streaming
Conflicts:
core/src/main/scala/spark/api/java/JavaRDDLike.scala
core/src/main/scala/spark/api/java/JavaSparkContext.scala
core/src/test/scala/spark/JavaAPISuite.java
|
2013-01-20 01:13:56 -08:00 |
|
Prashant Sharma
|
56b9bd197c
|
Plug in actor as stream receiver API
|
2013-01-19 22:04:07 +05:30 |
|
Prashant Sharma
|
bb6ab92e31
|
Changed method name of createReceiver to getReceiver as it is not intended to be a factory.
|
2013-01-19 22:04:07 +05:30 |
|
seanm
|
d3064fe707
|
kafkaStream API cleanup. A quorum of zookeepers can now be specified
|
2013-01-18 21:34:29 -07:00 |
|
Patrick Wendell
|
12b72b3e73
|
NetworkWordCount example
|
2013-01-17 22:37:56 -08:00 |
|
Patrick Wendell
|
e0165bf714
|
Adding queueStream and some slight refactoring
|
2013-01-17 21:25:49 -08:00 |
|
Patrick Wendell
|
6fba7683c2
|
Small doc fix
|
2013-01-17 18:46:24 -08:00 |
|
Nick Pentreath
|
a5ba7a9f32
|
Use only one update function and pass in transpose of ratings matrix where appropriate
|
2013-01-17 16:21:00 +02:00 |
|
Nick Pentreath
|
a512df551f
|
Fixed index error missing first argument
|
2013-01-17 16:05:27 +02:00 |
|
Nick Pentreath
|
42fbef3c2a
|
Adding default command line args to SparkALS
|
2013-01-17 15:54:59 +02:00 |
|
Tathagata Das
|
cd1521cfdb
|
Merge branch 'master' into streaming
Conflicts:
core/src/main/scala/spark/rdd/CoGroupedRDD.scala
core/src/main/scala/spark/rdd/FilteredRDD.scala
docs/_layouts/global.html
docs/index.md
run
|
2013-01-15 12:08:51 -08:00 |
|
Patrick Wendell
|
d182a57cae
|
Two changes:
- Updating countByX() types based on bug fix
- Porting new documentation to Java
|
2013-01-14 10:03:55 -08:00 |
|
Patrick Wendell
|
3461cd99b7
|
Flume example and bug fix
|
2013-01-14 09:42:36 -08:00 |
|
Tathagata Das
|
0a2e333341
|
Removed stream id from the constructor of NetworkReceiver to make it easier for PluggableNetworkInputDStream.
|
2013-01-13 16:18:39 -08:00 |
|