Matei Zaharia
|
ee5a07955c
|
Fix Python guide to say accumulators are available
|
2013-01-20 02:11:58 -08:00 |
|
Matei Zaharia
|
a23ed25f3c
|
Add a class comment to Accumulator
|
2013-01-20 02:10:25 -08:00 |
|
Matei Zaharia
|
61b6382a35
|
Launch accumulator tests in run-tests
|
2013-01-20 01:59:07 -08:00 |
|
Matei Zaharia
|
8e7f098a2c
|
Added accumulators to PySpark
|
2013-01-20 01:57:44 -08:00 |
|
Tathagata Das
|
4f8fe58b25
|
Merge branch 'mesos-streaming' into streaming
Conflicts:
core/src/main/scala/spark/api/java/JavaRDDLike.scala
core/src/main/scala/spark/api/java/JavaSparkContext.scala
core/src/test/scala/spark/JavaAPISuite.java
|
2013-01-20 01:13:56 -08:00 |
|
Tathagata Das
|
214345ceac
|
Fixed issue https://spark-project.atlassian.net/browse/STREAMING-29, along with updates to doc comments in SparkContext.checkpoint().
|
2013-01-19 23:50:17 -08:00 |
|
Patrick Wendell
|
ecdff861f7
|
Clarifying log directory in EC2 guide
|
2013-01-19 22:59:35 -08:00 |
|
Patrick Wendell
|
11bbe23140
|
Merge pull request #369 from pwendell/streaming-java-api
Java API For Spark Streaming
|
2013-01-17 22:39:30 -08:00 |
|
Patrick Wendell
|
12b72b3e73
|
NetworkWordCount example
|
2013-01-17 22:37:56 -08:00 |
|
Patrick Wendell
|
c46dd2de78
|
Moving tests to appropriate directory
|
2013-01-17 21:43:17 -08:00 |
|
Patrick Wendell
|
e0165bf714
|
Adding queueStream and some slight refactoring
|
2013-01-17 21:25:49 -08:00 |
|
Patrick Wendell
|
6fba7683c2
|
Small doc fix
|
2013-01-17 18:46:24 -08:00 |
|
Patrick Wendell
|
ee0314c3b3
|
Merge branch 'streaming' into streaming-java-api
|
2013-01-17 18:43:00 -08:00 |
|
Patrick Wendell
|
70ba994d6d
|
Import fixup
|
2013-01-17 18:41:59 -08:00 |
|
Patrick Wendell
|
2261e62ee5
|
Style cleanup
|
2013-01-17 18:41:59 -08:00 |
|
Patrick Wendell
|
82b8707c6b
|
Checkpointing in Streaming java API
|
2013-01-17 18:41:58 -08:00 |
|
Patrick Wendell
|
61b877c688
|
Adding flatMap
|
2013-01-17 18:41:58 -08:00 |
|
Patrick Wendell
|
d5570c7968
|
Adding checkpointing to Java API
|
2013-01-17 18:41:58 -08:00 |
|
Patrick Wendell
|
8e6cbbc6c7
|
Adding other updateState functions
|
2013-01-17 18:41:58 -08:00 |
|
Patrick Wendell
|
2a872335c5
|
Bug fix and test cleanup
|
2013-01-17 18:41:58 -08:00 |
|
Matei Zaharia
|
54c0f9f185
|
Fix code that assumed spark.local.dir is only a single directory
|
2013-01-17 17:40:55 -08:00 |
|
Matei Zaharia
|
b534fd363f
|
Merge pull request #382 from fanuo/master
HttpBroadcast server cache by default in spark.local.dir instead of java.io.tmpdir
|
2013-01-17 17:00:25 -08:00 |
|
Fernand Pajot
|
742bc841ad
|
changed HttpBroadcast server cache to be in spark.local.dir instead of java.io.tmpdir
|
2013-01-17 16:56:11 -08:00 |
|
Matei Zaharia
|
46644e409d
|
Merge branch 'master' of github.com:mesos/spark
|
2013-01-17 11:17:19 -08:00 |
|
Matei Zaharia
|
892c32a14b
|
Warn users if they run pyspark or spark-shell without compiling Spark
|
2013-01-17 11:14:47 -08:00 |
|
Nick Pentreath
|
a5ba7a9f32
|
Use only one update function and pass in transpose of ratings matrix where appropriate
|
2013-01-17 16:21:00 +02:00 |
|
Nick Pentreath
|
a512df551f
|
Fixed index error missing first argument
|
2013-01-17 16:05:27 +02:00 |
|
Nick Pentreath
|
42fbef3c2a
|
Adding default command line args to SparkALS
|
2013-01-17 15:54:59 +02:00 |
|
Matei Zaharia
|
aff1844155
|
Merge pull request #381 from squito/remove_threadpool
remove unused thread pool
|
2013-01-16 16:46:42 -08:00 |
|
Tathagata Das
|
f466ee44bc
|
Merge branch 'master' into streaming
Conflicts:
core/src/main/scala/spark/MapOutputTracker.scala
|
2013-01-16 12:57:11 -08:00 |
|
Imran Rashid
|
eae698f755
|
remove unused thread pool
|
2013-01-16 12:21:37 -08:00 |
|
Tathagata Das
|
a805ac4a7c
|
Disabled checkpoint for PairwiseRDD (pySpark).
|
2013-01-16 10:55:26 -08:00 |
|
Matei Zaharia
|
4beb084f64
|
Merge pull request #374 from woggling/null-mapout
Generate FetchFailedException even for cached missing map outputs
|
2013-01-15 14:22:29 -08:00 |
|
Matei Zaharia
|
7adfedb0d7
|
Merge pull request #378 from apsaltis/master
Updated SCALA_VERSION in run2.cmd to match runtime version of Scala
|
2013-01-15 14:20:44 -08:00 |
|
Tathagata Das
|
cd1521cfdb
|
Merge branch 'master' into streaming
Conflicts:
core/src/main/scala/spark/rdd/CoGroupedRDD.scala
core/src/main/scala/spark/rdd/FilteredRDD.scala
docs/_layouts/global.html
docs/index.md
run
|
2013-01-15 12:08:51 -08:00 |
|
Charles Reiss
|
4078623b9f
|
Remove broken attempt to test fetching case.
|
2013-01-15 12:05:54 -08:00 |
|
Andrew Psaltis
|
c7143e5507
|
Changed teh scala version to 2.9.2, so that the classes can be found when the classpath is expanded.
|
2013-01-15 12:45:42 -07:00 |
|
Matei Zaharia
|
3a98611d6b
|
Merge pull request #377 from stephenh/executeOnCompleteCallbackInFinally
Call executeOnCompleteCallbacks in a finally block.
|
2013-01-15 10:38:04 -08:00 |
|
Stephen Haberman
|
d228bff440
|
Add a test.
|
2013-01-15 11:48:50 -06:00 |
|
Stephen Haberman
|
dd583b7ebf
|
Call executeOnCompleteCallbacks in a finally block.
|
2013-01-15 10:52:06 -06:00 |
|
Tathagata Das
|
eded21925a
|
Merge pull request #375 from tdas/streaming
Important bug fixes
|
2013-01-14 23:06:40 -08:00 |
|
Nick Pentreath
|
b77f7390a5
|
Python ALS example
|
2013-01-15 09:04:32 +02:00 |
|
Tathagata Das
|
1638fcb0dc
|
Fixed updateStateByKey to work with primitive types.
|
2013-01-14 17:18:39 -08:00 |
|
Charles Reiss
|
b038999797
|
Fix accidental spark.master.host reuse
|
2013-01-14 17:04:44 -08:00 |
|
Charles Reiss
|
7ba34bc007
|
Additional tests for MapOutputTracker.
|
2013-01-14 15:27:02 -08:00 |
|
Charles Reiss
|
273fb5cc10
|
Throw FetchFailedException for cached missing locs
|
2013-01-14 15:26:48 -08:00 |
|
Patrick Wendell
|
a0013beb03
|
Stash
|
2013-01-14 15:15:02 -08:00 |
|
Patrick Wendell
|
8ad6220bd3
|
Bugfix
|
2013-01-14 14:56:36 -08:00 |
|
Patrick Wendell
|
38d9a3a863
|
Remove AnyRef constraint in updateState
|
2013-01-14 13:31:49 -08:00 |
|
Patrick Wendell
|
ae5290f4a2
|
Bug fix
|
2013-01-14 13:31:32 -08:00 |
|