Imran Rashid
|
85940a7d71
|
rename addToAccum to addAccumulator
|
2012-07-16 18:17:13 -07:00 |
|
Mosharaf Chowdhury
|
85cd9979f2
|
Fix for isLocal
|
2012-07-13 01:13:14 -07:00 |
|
|
Mosharaf Chowdhury
|
1c83fd4b66
|
Merged with Upstream dev
|
2012-07-13 01:08:28 -07:00 |
|
|
Mosharaf Chowdhury
|
bb4ee580fa
|
Cleaning BitTorrentBroadcast code...
|
2012-07-13 01:04:01 -07:00 |
|
|
Mosharaf Chowdhury
|
8ccffe21da
|
Cleaned TreeBroadcast
|
2012-07-13 00:54:25 -07:00 |
|
Matei Zaharia
|
a33ca6949c
|
Merge branch 'master' of github.com:mesos/spark
|
2012-07-12 18:38:20 -07:00 |
|
|
Matei Zaharia
|
452330efb4
|
Allow null keys in Spark's reduce and group by
|
2012-07-12 18:37:37 -07:00 |
|
|
Matei Zaharia
|
628bb5ca7f
|
Allow null keys in Spark's reduce and group by
|
2012-07-12 18:36:02 -07:00 |
|
|
Matei Zaharia
|
e2a67a8024
|
Fixes to coarse-grained Mesos scheduler in dealing with failed nodes
|
2012-07-12 18:21:52 -07:00 |
|
|
Imran Rashid
|
86024ca74d
|
add some functionality to Vector, delete copy in AccumulatorSuite
|
2012-07-12 13:08:03 -07:00 |
|
|
Imran Rashid
|
42ce879486
|
move Vector class into core and spark.util package
|
2012-07-12 13:08:03 -07:00 |
|
|
Imran Rashid
|
13cc72cfb5
|
Accumulator now inherits from Accumulable, whcih simplifies a bunch of other things (eg., no +:=)
|
2012-07-12 12:40:10 -07:00 |
|
|
Imran Rashid
|
73935629a1
|
improve scaladoc
|
2012-07-12 09:58:06 -07:00 |
|
|
Imran Rashid
|
30480e6dae
|
add Accumulatable, add corresponding docs & tests for accumulators
|
2012-07-12 09:37:42 -07:00 |
|
|
Matei Zaharia
|
be622cf867
|
Formatting
|
2012-07-11 17:31:44 -07:00 |
|
|
Matei Zaharia
|
e8ae77df24
|
Added more methods for loading/saving with new Hadoop API
|
2012-07-11 17:31:33 -07:00 |
|
|
Matei Zaharia
|
4259d37f84
|
Formatting
|
2012-07-10 11:16:34 -07:00 |
|
|
Matei Zaharia
|
6980b67557
|
Added more methods for loading/saving with new Hadoop API
|
2012-07-10 11:11:35 -07:00 |
|
|
Mosharaf Chowdhury
|
34999d97f5
|
Added stop() to the Broadcast subsystem
|
2012-07-10 01:03:47 -07:00 |
|
|
Mosharaf Chowdhury
|
d6a9680604
|
Slightly better check for isLocal
|
2012-07-10 00:16:47 -07:00 |
|
|
Mosharaf Chowdhury
|
701f49e0d9
|
Refactoring
|
2012-07-09 22:39:47 -07:00 |
|
|
Mosharaf Chowdhury
|
cf1c60a1de
|
Refactoring
|
2012-07-09 22:07:46 -07:00 |
|
|
Mosharaf Chowdhury
|
e71f69ad3d
|
Refactoring
|
2012-07-09 22:07:17 -07:00 |
|
|
Mosharaf Chowdhury
|
ca02a92332
|
Refactored TrackMultipleValues out.
|
2012-07-09 21:35:39 -07:00 |
|
|
Mosharaf Chowdhury
|
654576ef1a
|
Tweaks
|
2012-07-09 21:12:42 -07:00 |
|
|
Mosharaf Chowdhury
|
425c247269
|
Removed some unused stuff
|
2012-07-08 14:29:04 -07:00 |
|
|
Matei Zaharia
|
0a47284003
|
More work to allow Spark to run on the standalone deploy cluster.
|
2012-07-08 14:00:04 -07:00 |
|
|
Mosharaf Chowdhury
|
c7c5258e25
|
Compiles without Dfs
|
2012-07-08 13:22:12 -07:00 |
|
|
Mosharaf Chowdhury
|
178bb29f05
|
Removed Chained and Dfs broadcast implementations
|
2012-07-08 11:57:00 -07:00 |
|
|
Matei Zaharia
|
1aa63f775b
|
Added back coarse-grained Mesos scheduler based on StandaloneScheduler.
|
2012-07-08 10:52:13 -07:00 |
|
|
Matei Zaharia
|
c5cc10cda3
|
More work on standalone scheduler
|
2012-07-06 20:17:44 -07:00 |
|
|
Matei Zaharia
|
909b325243
|
Further refactoring, and start of a standalone scheduler backend
|
2012-07-06 17:56:44 -07:00 |
|
|
Matei Zaharia
|
4e2fe0bdaf
|
Miscellaneous bug fixes
|
2012-07-06 16:33:40 -07:00 |
|
|
Matei Zaharia
|
e72afdb817
|
Some refactoring to make cluster scheduler pluggable.
|
2012-07-06 15:23:26 -07:00 |
|
|
Matei Zaharia
|
5d1a887bed
|
Further updates to run processes on cluster.
|
2012-07-01 17:13:31 -07:00 |
|
|
Matei Zaharia
|
51c46eaca0
|
More work on standalone deploy system.
|
2012-07-01 01:05:59 -07:00 |
|
|
Matei Zaharia
|
a6eb9fda61
|
Detect connection and disconnection of slaves
|
2012-06-30 17:46:56 -07:00 |
|
|
Matei Zaharia
|
408b5a1332
|
More work on deploy code (adding Worker class)
|
2012-06-30 16:45:57 -07:00 |
|
|
Matei Zaharia
|
2fb6e7d71e
|
Initial framework to get a master and web UI up.
|
2012-06-30 14:45:55 -07:00 |
|
|
Matei Zaharia
|
c53670b9bf
|
Various code style fixes, mostly from IntelliJ IDEA
|
2012-06-29 18:47:12 -07:00 |
|
rrmckinley
|
697b0bee2c
|
Scalacheck groupId has changed https://github.com/rickynils/scalacheck/issues/24. Necessary to build with scalaVersion 2.9.2. Works with 2.9.1 too.
|
2012-06-29 16:42:05 -07:00 |
|
|
Matei Zaharia
|
cbe88465a9
|
Merge pull request #142 from rrmckinley/patch-1
Scalacheck groupId has changed https://github.com/rickynils/scalacheck/i...
|
2012-06-29 16:40:57 -07:00 |
|
|
Matei Zaharia
|
8a5bd4e765
|
Increase the default wait time for EC2 clusters to 2 minutes.
|
2012-06-29 16:25:40 -07:00 |
|
|
Matei Zaharia
|
3a326c0ddd
|
Increase the default wait time for EC2 clusters to 2 minutes.
|
2012-06-29 16:25:06 -07:00 |
|
|
Matei Zaharia
|
c6be4ffbf9
|
Fixes to CoarseMesosScheduler
|
2012-06-29 16:18:51 -07:00 |
|
|
Matei Zaharia
|
3a58efa5a5
|
Allow binding to a free port and change Akka logging to use SLF4J. Also
fixes various bugs in the previous code when running on Mesos.
|
2012-06-29 16:02:21 -07:00 |
|
|
rrmckinley
|
25972b52cd
|
Scalacheck groupId has changed https://github.com/rickynils/scalacheck/issues/24. Necessary to build with scalaVersion 2.9.2. Works with 2.9.1 too.
|
2012-06-29 12:00:23 -07:00 |
|
|
Matei Zaharia
|
14bfad1183
|
Ignore some IDE files
|
2012-06-28 23:52:33 -07:00 |
|
|
Matei Zaharia
|
3920189932
|
Upgraded to Akka 2 and fixed test execution (which was still parallel
across projects).
|
2012-06-28 23:51:28 -07:00 |
|
Tathagata Das
|
ede615d719
|
Fixed issues duplicate class issues in sbt assembly.
|
2012-06-22 15:03:09 -07:00 |
|