Matei Zaharia
|
94ba95bcb2
|
Added flatMapValues
|
2011-04-12 19:51:58 -07:00 |
|
Matei Zaharia
|
d840fa8d0c
|
Merge remote branch 'origin/custom-serialization' into new-rdds
|
2011-03-09 00:40:07 -08:00 |
|
root
|
ff5b13799a
|
Some tweaks to make Kryo cache work better
|
2011-03-09 03:31:50 -05:00 |
|
Matei Zaharia
|
7febdfbe29
|
Better reuse of buffers in Kryo serialization
|
2011-03-08 12:36:36 -08:00 |
|
Matei Zaharia
|
8ee3ec29ee
|
Merge remote branch 'origin/custom-serialization' into new-rdds
|
2011-03-08 11:58:19 -08:00 |
|
Matei Zaharia
|
7408230bfa
|
Updated modified Kryo to use objenesis
|
2011-03-08 11:58:08 -08:00 |
|
Matei Zaharia
|
ab1216cb14
|
Register None and Nil properly
|
2011-03-08 11:52:58 -08:00 |
|
Matei Zaharia
|
d39f5dd15e
|
Merge remote branch 'origin/custom-serialization' into new-rdds
|
2011-03-08 10:28:50 -08:00 |
|
Matei Zaharia
|
4f0d0a7b73
|
stuff
|
2011-03-08 10:28:26 -08:00 |
|
Matei Zaharia
|
8b6f3db415
|
Merge remote branch 'origin/custom-serialization' into new-rdds
|
2011-03-07 19:20:28 -08:00 |
|
Matei Zaharia
|
38f6bce33d
|
Added SerializingCache
|
2011-03-07 19:16:24 -08:00 |
|
Matei Zaharia
|
6316c7979d
|
Remove some logging
|
2011-03-07 18:56:36 -08:00 |
|
Matei Zaharia
|
e7b4b047a6
|
Added pluggable serializers and Kryo serialization
|
2011-03-07 18:41:53 -08:00 |
|
Matei Zaharia
|
467f056e29
|
Remove commented code
|
2011-03-06 23:38:41 -08:00 |
|
Matei Zaharia
|
bce95b8458
|
Finished cogroup stuff
|
2011-03-06 23:38:16 -08:00 |
|
Matei Zaharia
|
04c2d6a60c
|
stuff
|
2011-03-06 19:27:03 -08:00 |
|
Matei Zaharia
|
0fb691dd28
|
Various fixes to get MesosScheduler working with new RDDs
|
2011-03-06 16:16:38 -08:00 |
|
Matei Zaharia
|
1df5a65a01
|
Pass cache locations correctly to DAGScheduler.
|
2011-03-06 12:16:38 -08:00 |
|
Matei Zaharia
|
e1436f1eaa
|
Merge remote branch 'origin/master' into new-rdds
|
2011-03-06 11:11:47 -08:00 |
|
Matei Zaharia
|
370b95816f
|
Added sampling for large arrays in SizeEstimator
|
2011-03-06 11:11:20 -08:00 |
|
Matei Zaharia
|
a789e9aaea
|
Merge remote branch 'origin/master' into new-rdds
|
2011-03-01 10:33:37 -08:00 |
|
Matei Zaharia
|
021c50a8d4
|
Remove unnecessary lock which was there to work around a bug in
Configuration in Hadoop 0.20.0
|
2011-03-01 10:28:38 -08:00 |
|
Matei Zaharia
|
adaba4d550
|
Removed old slf4j jars that came with Hadoop
|
2011-03-01 10:28:21 -08:00 |
|
Matei Zaharia
|
447debb771
|
Updated Hadoop to 0.20.2 to include some bug fixes
|
2011-03-01 10:27:48 -08:00 |
|
Matei Zaharia
|
9e59afd710
|
More work on new RDD design
|
2011-02-27 19:15:52 -08:00 |
|
Matei Zaharia
|
f38f86d59e
|
More stuff
|
2011-02-27 14:27:12 -08:00 |
|
Matei Zaharia
|
2e6023f2bf
|
stuff
|
2011-02-26 23:41:44 -08:00 |
|
Matei Zaharia
|
309367c477
|
Initial work towards new RDD design
|
2011-02-26 23:15:33 -08:00 |
|
Matei Zaharia
|
dc24aecd8f
|
Close record readers in HadoopFile after finishing a split
|
2011-02-10 12:07:48 -08:00 |
|
Matei Zaharia
|
99f3f23efa
|
Changed default shuffle to LocalFileShuffle because it's way faster for small files
|
2011-02-08 17:03:03 -08:00 |
|
Matei Zaharia
|
ec28b607fd
|
Merge branch 'master' into sbt
Conflicts:
Makefile
core/src/main/java/spark/compress/lzf/LZF.java
core/src/main/java/spark/compress/lzf/LZFInputStream.java
core/src/main/java/spark/compress/lzf/LZFOutputStream.java
core/src/main/native/spark_compress_lzf_LZF.c
run
|
2011-02-02 00:25:54 -08:00 |
|
Matei Zaharia
|
e5c4cd8a5e
|
Made examples and core subprojects
|
2011-02-01 15:11:08 -08:00 |
|