Patrick Wendell
|
04786d0739
|
small fix
|
2013-02-11 10:05:49 -08:00 |
|
|
Patrick Wendell
|
c65988bdc1
|
Fix for MapPartitions
|
2013-02-11 10:03:37 -08:00 |
|
|
Patrick Wendell
|
20cf770545
|
Fix for flatmap
|
2013-02-11 10:03:37 -08:00 |
|
|
Patrick Wendell
|
314d87a038
|
Indentation fix
|
2013-02-11 10:03:37 -08:00 |
|
|
Patrick Wendell
|
f0b68c623c
|
Initial cut at replacing K, V in Java files
|
2013-02-11 10:03:37 -08:00 |
|
Stephen Haberman
|
7dfb82a992
|
Replace old 'master' term with 'driver'.
|
2013-01-25 11:03:00 -06:00 |
|
|
Stephen Haberman
|
e5ca241335
|
Move JavaAPISuite into spark.streaming.
|
2013-01-21 16:06:58 -06:00 |
|
Tathagata Das
|
33bad85bb9
|
Fixed streaming testsuite bugs
|
2013-01-20 03:51:11 -08:00 |
|
|
Patrick Wendell
|
c46dd2de78
|
Moving tests to appropriate directory
|
2013-01-17 21:43:17 -08:00 |
|
|
Patrick Wendell
|
e0165bf714
|
Adding queueStream and some slight refactoring
|
2013-01-17 21:25:49 -08:00 |
|
|
Patrick Wendell
|
ee0314c3b3
|
Merge branch 'streaming' into streaming-java-api
|
2013-01-17 18:43:00 -08:00 |
|
|
Patrick Wendell
|
70ba994d6d
|
Import fixup
|
2013-01-17 18:41:59 -08:00 |
|
|
Patrick Wendell
|
82b8707c6b
|
Checkpointing in Streaming java API
|
2013-01-17 18:41:58 -08:00 |
|
|
Patrick Wendell
|
61b877c688
|
Adding flatMap
|
2013-01-17 18:41:58 -08:00 |
|
|
Patrick Wendell
|
2a872335c5
|
Bug fix and test cleanup
|
2013-01-17 18:41:58 -08:00 |
|
|
Tathagata Das
|
1638fcb0dc
|
Fixed updateStateByKey to work with primitive types.
|
2013-01-14 17:18:39 -08:00 |
|
|
Patrick Wendell
|
a0013beb03
|
Stash
|
2013-01-14 15:15:02 -08:00 |
|
|
Patrick Wendell
|
5bcb048167
|
More work on InputStreams
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
280b6d0186
|
Porting to new Duration class
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
c2537057f9
|
Fixing issue with <Long> types
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
5004eec37c
|
Import Cleanup
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
2fe39a4468
|
Some docs for the JavaTestUtils
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
560c312c60
|
Docs, some tests, and work on
StreamingContext
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
6e514a8d35
|
PairDStream and DStreamLike
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
f144e0413a
|
Adding transform and union
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
0d0bab25bd
|
Reduce tests
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
22a8c7be9a
|
Adding more tests
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
91b3d41448
|
Better equality test (thanks Josh)
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
b0974e6c1d
|
Remving main method from tests
|
2013-01-14 09:42:36 -08:00 |
|
|
Patrick Wendell
|
867a7455e2
|
Adding some initial tests to streaming API.
|
2013-01-14 09:42:36 -08:00 |
|
|
Tathagata Das
|
6cc8592f26
|
Fixed bug
|
2013-01-13 21:20:49 -08:00 |
|
|
Tathagata Das
|
365506fb03
|
Changed variable name form ***Time to ***Duration to keep things consistent.
|
2013-01-09 14:29:25 -08:00 |
|
|
Tathagata Das
|
4719e6d8fe
|
Changed locations for unit test logs.
|
2013-01-07 16:06:07 -08:00 |
|
|
Tathagata Das
|
e60514d79e
|
Fixed bug
|
2013-01-07 15:16:16 -08:00 |
|
|
Tathagata Das
|
237bac36e9
|
Renamed examples and added documentation.
|
2013-01-07 14:37:21 -08:00 |
|
|
Tathagata Das
|
7e0271b438
|
Refactored a whole lot to push all DStreams into the spark.streaming.dstream package.
|
2012-12-30 15:19:55 -08:00 |
|
|
Tathagata Das
|
9e644402c1
|
Improved jekyll and scala docs. Made many classes and method private to remove them from scala docs.
|
2012-12-29 18:31:51 -08:00 |
|
|
Tathagata Das
|
0bc0a60d30
|
Modifications to make sure LocalScheduler terminate cleanly without errors when SparkContext is shutdown, to minimize spurious exception during master failure tests.
|
2012-12-27 15:37:33 -08:00 |
|
|
Patrick Wendell
|
3ff9710265
|
Adding Flume InputDStream
|
2012-12-07 16:42:39 -08:00 |
|
Denny
|
15df4b0e52
|
Merge branch 'dev' into kafka
Conflicts:
streaming/src/main/scala/spark/streaming/DStream.scala
|
2012-12-05 10:16:56 -08:00 |
|
|
Tathagata Das
|
0fe2fc4d5e
|
Merged branch mesos/master to branch dev.
|
2012-11-26 13:16:59 -08:00 |
|
|
Tathagata Das
|
fd11d23bb3
|
Modified StreamingContext API to make constructor accept the batch size (since it is always needed, Patrick's suggestion). Added description to DStream and StreamingContext.
|
2012-11-19 19:04:39 -08:00 |
|
|
Denny
|
2aceae25be
|
Merge branch 'dev' into kafka
Conflicts:
streaming/src/main/scala/spark/streaming/DStream.scala
|
2012-11-13 13:16:18 -08:00 |
|
|
Tathagata Das
|
8a25d530ed
|
Optimized checkpoint writing by reusing FileSystem object. Fixed bug in updating of checkpoint data in DStream where the checkpointed RDDs, upon recovery, were not recognized as checkpointed RDDs and therefore deleted from HDFS. Made InputStreamsSuite more robust to timing delays.
|
2012-11-13 02:16:28 -08:00 |
|
|
Denny
|
255b3e44c1
|
Merge branch 'dev' into kafka
|
2012-11-12 19:39:29 -08:00 |
|
|
Tathagata Das
|
564dd8c3f4
|
Speeded up CheckpointSuite
|
2012-11-12 14:22:05 -08:00 |
|
|
Tathagata Das
|
46222dc56d
|
Fixed bug in FileInputDStream that allowed it to miss new files. Added tests in the InputStreamsSuite to test checkpointing of file and network streams.
|
2012-11-11 13:20:09 -08:00 |
|
|
Denny
|
d006109e95
|
Kafka Stream comments.
|
2012-11-11 11:06:49 -08:00 |
|
|
tdas
|
cc2a65f547
|
Fixed bug in InputStreamsSuite
|
2012-11-08 11:17:57 +00:00 |
|
|
Tathagata Das
|
fc3d0b602a
|
Added FailureTestsuite for testing multiple, repeated master failures.
|
2012-11-06 17:23:31 -08:00 |
|