Matei Zaharia
|
548856a224
|
Merge remote-tracking branch 'woggling/remove-machines'
Conflicts:
core/src/main/scala/spark/scheduler/DAGScheduler.scala
|
2013-01-23 15:44:17 -08:00 |
|
Charles Reiss
|
5c7422292e
|
Remove more dead code from test.
|
2013-01-23 12:59:51 -08:00 |
|
Charles Reiss
|
88b9d240fd
|
Remove dead code in test.
|
2013-01-23 12:40:38 -08:00 |
|
Matei Zaharia
|
1a3aeeca23
|
Merge pull request #407 from woggling/no-cache-tracker
Eliminate CacheTracker
|
2013-01-23 12:28:48 -08:00 |
|
Matei Zaharia
|
4147e1d47b
|
Merge pull request #406 from tdas/master
Changed StorageLevel and BlockManagerId API to prevent duplication in memory
|
2013-01-23 12:18:31 -08:00 |
|
Matei Zaharia
|
4d77d554e1
|
Merge pull request #394 from JoshRosen/add_file_fix
Add SparkFiles.get() API to access files added through addFile().
|
2013-01-23 12:16:30 -08:00 |
|
Charles Reiss
|
0b506dd2ec
|
Add tests of various node failure scenarios.
|
2013-01-23 01:38:15 -08:00 |
|
Tathagata Das
|
5e11f1e51f
|
Modified StorageLevel API to ensure zero duplicate objects.
|
2013-01-22 23:42:53 -08:00 |
|
Tathagata Das
|
bacade6caf
|
Modified BlockManagerId API to ensure zero duplicate objects. Fixed BlockManagerId testcase in BlockManagerTestSuite.
|
2013-01-22 22:55:26 -08:00 |
|
Josh Rosen
|
43e9ff9596
|
Add test for driver hanging on exit (SPARK-530).
|
2013-01-22 22:47:26 -08:00 |
|
Charles Reiss
|
2849931000
|
Eliminate CacheTracker.
Replaces DAGScheduler's queries of CacheTracker with BlockManagerMaster
queries.
Adds CacheManager to locally coordinate computation of cached RDDs.
|
2013-01-22 22:19:30 -08:00 |
|
Josh Rosen
|
ef711902c1
|
Don't download files to master's working directory.
This should avoid exceptions caused by existing
files with different contents.
I also removed some unused code.
|
2013-01-21 17:34:17 -08:00 |
|
Stephen Haberman
|
ffd1623595
|
Minor cleanup.
|
2013-01-21 15:55:46 -06:00 |
|
Tathagata Das
|
4f8fe58b25
|
Merge branch 'mesos-streaming' into streaming
Conflicts:
core/src/main/scala/spark/api/java/JavaRDDLike.scala
core/src/main/scala/spark/api/java/JavaSparkContext.scala
core/src/test/scala/spark/JavaAPISuite.java
|
2013-01-20 01:13:56 -08:00 |
|
Patrick Wendell
|
d5570c7968
|
Adding checkpointing to Java API
|
2013-01-17 18:41:58 -08:00 |
|
Tathagata Das
|
f466ee44bc
|
Merge branch 'master' into streaming
Conflicts:
core/src/main/scala/spark/MapOutputTracker.scala
|
2013-01-16 12:57:11 -08:00 |
|
Matei Zaharia
|
4beb084f64
|
Merge pull request #374 from woggling/null-mapout
Generate FetchFailedException even for cached missing map outputs
|
2013-01-15 14:22:29 -08:00 |
|
Tathagata Das
|
cd1521cfdb
|
Merge branch 'master' into streaming
Conflicts:
core/src/main/scala/spark/rdd/CoGroupedRDD.scala
core/src/main/scala/spark/rdd/FilteredRDD.scala
docs/_layouts/global.html
docs/index.md
run
|
2013-01-15 12:08:51 -08:00 |
|
Charles Reiss
|
4078623b9f
|
Remove broken attempt to test fetching case.
|
2013-01-15 12:05:54 -08:00 |
|
Stephen Haberman
|
d228bff440
|
Add a test.
|
2013-01-15 11:48:50 -06:00 |
|
Charles Reiss
|
b038999797
|
Fix accidental spark.master.host reuse
|
2013-01-14 17:04:44 -08:00 |
|
Charles Reiss
|
7ba34bc007
|
Additional tests for MapOutputTracker.
|
2013-01-14 15:27:02 -08:00 |
|
Matei Zaharia
|
72408e8dfa
|
Make filter preserve partitioner info, since it can
|
2013-01-13 19:34:07 -08:00 |
|
Ryan LeCompte
|
ea20ae6618
|
add one extra test
|
2013-01-12 09:18:00 -08:00 |
|
Ryan LeCompte
|
2c77eeebb6
|
correct test params
|
2013-01-12 00:13:45 -08:00 |
|
Ryan LeCompte
|
0cfea7a2ec
|
add unit test
|
2013-01-11 23:48:07 -08:00 |
|
Stephen Haberman
|
8ac0f35be4
|
Add JavaRDDLike.keyBy.
|
2013-01-08 09:57:45 -06:00 |
|
Stephen Haberman
|
4ee6b22775
|
Merge branch 'master' into tupleBy
Conflicts:
core/src/test/scala/spark/RDDSuite.scala
|
2013-01-08 09:10:10 -06:00 |
|
Matei Zaharia
|
f7cf035b9b
|
Merge pull request #350 from tdas/streaming
Spark Streaming
|
2013-01-07 17:40:11 -08:00 |
|
Shivaram Venkataraman
|
b1336e2fe4
|
Update expected size of strings to match our dummy string class
|
2013-01-07 17:00:32 -08:00 |
|
Tathagata Das
|
4719e6d8fe
|
Changed locations for unit test logs.
|
2013-01-07 16:06:07 -08:00 |
|
Shivaram Venkataraman
|
55c66d365f
|
Use a dummy string class in Size Estimator tests to make it resistant to jdk
versions
|
2013-01-07 15:58:00 -08:00 |
|
Shivaram Venkataraman
|
77d751731c
|
Remove unused BoundedMemoryCache file and associated test case.
|
2013-01-07 15:57:46 -08:00 |
|
Matei Zaharia
|
1941d9602d
|
Merge branch 'master' of github.com:mesos/spark
|
2013-01-07 16:50:39 -05:00 |
|
Matei Zaharia
|
9c32f300fb
|
Add Accumulable.setValue for easier use in Java
|
2013-01-07 16:50:23 -05:00 |
|
Stephen Haberman
|
8dc06069fe
|
Rename RDD.tupleBy to keyBy.
|
2013-01-06 15:21:45 -06:00 |
|
Matei Zaharia
|
b1663752c6
|
Merge pull request #351 from stephenh/values
Add PairRDDFunctions.keys and values.
|
2013-01-05 19:15:54 -08:00 |
|
Matei Zaharia
|
0982572519
|
Add methods called just 'accumulator' for int/double in Java API
|
2013-01-05 22:11:28 -05:00 |
|
Matei Zaharia
|
86af64b0a6
|
Fix Accumulators in Java, and add a test for them
|
2013-01-05 20:55:17 -05:00 |
|
Matei Zaharia
|
ecf9c08901
|
Fix Accumulators in Java, and add a test for them
|
2013-01-05 20:54:08 -05:00 |
|
Stephen Haberman
|
1fdb6946b5
|
Add RDD.tupleBy.
|
2013-01-05 13:07:59 -06:00 |
|
Stephen Haberman
|
6a0db3b449
|
Fix typo.
|
2013-01-05 12:56:17 -06:00 |
|
Stephen Haberman
|
f4e6b9361f
|
Add RDD.collect(PartialFunction).
|
2013-01-05 12:14:08 -06:00 |
|
Stephen Haberman
|
8d57c78c83
|
Add PairRDDFunctions.keys and values.
|
2013-01-05 12:04:01 -06:00 |
|
Tathagata Das
|
3dc87dd923
|
Fixed compilation bug in RDDSuite created during merge for mesos/master.
|
2013-01-01 16:38:04 -08:00 |
|
Tathagata Das
|
d34dba25c2
|
Merge branch 'mesos' into dev-merge
|
2013-01-01 15:48:39 -08:00 |
|
Matei Zaharia
|
55809fbc6d
|
Merge pull request #349 from woggling/cache-finally
Avoid stalls when computation of cached RDD throws exception
|
2013-01-01 08:21:33 -08:00 |
|
Charles Reiss
|
21636ee4fa
|
Test with exception while computing cached RDD.
|
2013-01-01 08:07:40 -08:00 |
|
Josh Rosen
|
f803953998
|
Raise exception when hashing Java arrays (SPARK-597)
|
2012-12-31 20:20:11 -08:00 |
|
Tathagata Das
|
0bc0a60d30
|
Modifications to make sure LocalScheduler terminate cleanly without errors when SparkContext is shutdown, to minimize spurious exception during master failure tests.
|
2012-12-27 15:37:33 -08:00 |
|