Denny
|
866e6949df
|
Always destroy SparkContext in after block for the unit tests.
Conflicts:
core/src/test/scala/spark/ShuffleSuite.scala
|
2012-07-23 16:29:17 -07:00 |
|
Matei Zaharia
|
600e99728d
|
Fix a bug where an input path was added to a Hadoop job configuration twice
|
2012-07-23 16:16:19 -07:00 |
|
Matei Zaharia
|
da4298135c
|
Merge pull request #152 from dennybritz/fix/testbeforeafter
Always destroy SparkContext in after block for the unit tests.
|
2012-07-23 16:13:24 -07:00 |
|
Denny
|
5656dcdfe5
|
Stlystic changes
|
2012-07-23 10:36:52 -07:00 |
|
Josh Rosen
|
042dcbde33
|
Add type annotations to Java API methods.
Add missing Scala Map to java.util.Map conversions.
|
2012-07-22 17:35:29 -07:00 |
|
Josh Rosen
|
e23938c3be
|
Use mapValues() in JavaPairRDD.cogroupResultToJava().
|
2012-07-22 15:10:01 -07:00 |
|
Josh Rosen
|
460da878fc
|
Improve Java API examples
- Replace JavaLR example with JavaHdfsLR example.
- Use anonymous classes in JavaWordCount; add options.
- Remove @Override annotations.
|
2012-07-22 14:40:39 -07:00 |
|
Matei Zaharia
|
840e1b21e4
|
Merge branch 'master' of github.com:mesos/spark
|
2012-07-21 21:58:40 -07:00 |
|
Matei Zaharia
|
6f44c0db74
|
Fix a bug where an input path was added to a Hadoop job configuration twice
|
2012-07-21 21:58:28 -07:00 |
|
Matei Zaharia
|
d1759c0290
|
Merge pull request #149 from dennybritz/serfix
Instantiating custom serializer using user's classpath
|
2012-07-21 21:54:50 -07:00 |
|
Matei Zaharia
|
5122f11b05
|
Use full package name in import
|
2012-07-21 21:53:38 -07:00 |
|
Josh Rosen
|
01dce3f569
|
Add Java API
Add distinct() method to RDD.
Fix bug in DoubleRDDFunctions.
|
2012-07-18 17:34:29 -07:00 |
|
Denny
|
5559608e6f
|
Always destroy SparkContext in after block for the unit tests.
|
2012-07-18 13:09:50 -07:00 |
|
Denny
|
e4dbaf653f
|
syntax errors
|
2012-07-18 12:18:00 -07:00 |
|
Denny
|
1d98884548
|
Use extended constructor in the examples.
|
2012-07-18 11:46:03 -07:00 |
|
Denny
|
2132c541f0
|
Create the ClassLoader before creating a SparkEnv - SparkEnv must use the loader.
|
2012-07-17 14:05:26 -07:00 |
|
Denny
|
2b84b50a85
|
Use Context classloader for Serializer class
|
2012-07-17 13:55:23 -07:00 |
|
Imran Rashid
|
7f43ba7ffa
|
one more minor cleanup to scaladoc
|
2012-07-16 18:26:48 -07:00 |
|
Imran Rashid
|
913d42c6a0
|
fix up scaladoc, naming of type parameters
|
2012-07-16 18:25:15 -07:00 |
|
Imran Rashid
|
85940a7d71
|
rename addToAccum to addAccumulator
|
2012-07-16 18:17:13 -07:00 |
|
Mosharaf Chowdhury
|
85cd9979f2
|
Fix for isLocal
|
2012-07-13 01:13:14 -07:00 |
|
Mosharaf Chowdhury
|
1c83fd4b66
|
Merged with Upstream dev
|
2012-07-13 01:08:28 -07:00 |
|
Mosharaf Chowdhury
|
bb4ee580fa
|
Cleaning BitTorrentBroadcast code...
|
2012-07-13 01:04:01 -07:00 |
|
Mosharaf Chowdhury
|
8ccffe21da
|
Cleaned TreeBroadcast
|
2012-07-13 00:54:25 -07:00 |
|
Matei Zaharia
|
a33ca6949c
|
Merge branch 'master' of github.com:mesos/spark
|
2012-07-12 18:38:20 -07:00 |
|
Matei Zaharia
|
452330efb4
|
Allow null keys in Spark's reduce and group by
|
2012-07-12 18:37:37 -07:00 |
|
Matei Zaharia
|
628bb5ca7f
|
Allow null keys in Spark's reduce and group by
|
2012-07-12 18:36:02 -07:00 |
|
Matei Zaharia
|
e2a67a8024
|
Fixes to coarse-grained Mesos scheduler in dealing with failed nodes
|
2012-07-12 18:21:52 -07:00 |
|
Imran Rashid
|
86024ca74d
|
add some functionality to Vector, delete copy in AccumulatorSuite
|
2012-07-12 13:08:03 -07:00 |
|
Imran Rashid
|
42ce879486
|
move Vector class into core and spark.util package
|
2012-07-12 13:08:03 -07:00 |
|
Imran Rashid
|
13cc72cfb5
|
Accumulator now inherits from Accumulable, whcih simplifies a bunch of other things (eg., no +:=)
|
2012-07-12 12:40:10 -07:00 |
|
Imran Rashid
|
73935629a1
|
improve scaladoc
|
2012-07-12 09:58:06 -07:00 |
|
Imran Rashid
|
30480e6dae
|
add Accumulatable, add corresponding docs & tests for accumulators
|
2012-07-12 09:37:42 -07:00 |
|
Matei Zaharia
|
be622cf867
|
Formatting
|
2012-07-11 17:31:44 -07:00 |
|
Matei Zaharia
|
e8ae77df24
|
Added more methods for loading/saving with new Hadoop API
|
2012-07-11 17:31:33 -07:00 |
|
Matei Zaharia
|
4259d37f84
|
Formatting
|
2012-07-10 11:16:34 -07:00 |
|
Matei Zaharia
|
6980b67557
|
Added more methods for loading/saving with new Hadoop API
|
2012-07-10 11:11:35 -07:00 |
|
Mosharaf Chowdhury
|
34999d97f5
|
Added stop() to the Broadcast subsystem
|
2012-07-10 01:03:47 -07:00 |
|
Mosharaf Chowdhury
|
d6a9680604
|
Slightly better check for isLocal
|
2012-07-10 00:16:47 -07:00 |
|
Mosharaf Chowdhury
|
701f49e0d9
|
Refactoring
|
2012-07-09 22:39:47 -07:00 |
|
Mosharaf Chowdhury
|
cf1c60a1de
|
Refactoring
|
2012-07-09 22:07:46 -07:00 |
|
Mosharaf Chowdhury
|
e71f69ad3d
|
Refactoring
|
2012-07-09 22:07:17 -07:00 |
|
Mosharaf Chowdhury
|
ca02a92332
|
Refactored TrackMultipleValues out.
|
2012-07-09 21:35:39 -07:00 |
|
Mosharaf Chowdhury
|
654576ef1a
|
Tweaks
|
2012-07-09 21:12:42 -07:00 |
|
Mosharaf Chowdhury
|
425c247269
|
Removed some unused stuff
|
2012-07-08 14:29:04 -07:00 |
|
Matei Zaharia
|
0a47284003
|
More work to allow Spark to run on the standalone deploy cluster.
|
2012-07-08 14:00:04 -07:00 |
|
Mosharaf Chowdhury
|
c7c5258e25
|
Compiles without Dfs
|
2012-07-08 13:22:12 -07:00 |
|
Mosharaf Chowdhury
|
178bb29f05
|
Removed Chained and Dfs broadcast implementations
|
2012-07-08 11:57:00 -07:00 |
|
Matei Zaharia
|
1aa63f775b
|
Added back coarse-grained Mesos scheduler based on StandaloneScheduler.
|
2012-07-08 10:52:13 -07:00 |
|
Matei Zaharia
|
c5cc10cda3
|
More work on standalone scheduler
|
2012-07-06 20:17:44 -07:00 |
|