Matei Zaharia
|
54c0f9f185
|
Fix code that assumed spark.local.dir is only a single directory
|
2013-01-17 17:40:55 -08:00 |
|
Fernand Pajot
|
742bc841ad
|
changed HttpBroadcast server cache to be in spark.local.dir instead of java.io.tmpdir
|
2013-01-17 16:56:11 -08:00 |
|
Matei Zaharia
|
aff1844155
|
Merge pull request #381 from squito/remove_threadpool
remove unused thread pool
|
2013-01-16 16:46:42 -08:00 |
|
Imran Rashid
|
eae698f755
|
remove unused thread pool
|
2013-01-16 12:21:37 -08:00 |
|
Matei Zaharia
|
4beb084f64
|
Merge pull request #374 from woggling/null-mapout
Generate FetchFailedException even for cached missing map outputs
|
2013-01-15 14:22:29 -08:00 |
|
Charles Reiss
|
4078623b9f
|
Remove broken attempt to test fetching case.
|
2013-01-15 12:05:54 -08:00 |
|
Stephen Haberman
|
d228bff440
|
Add a test.
|
2013-01-15 11:48:50 -06:00 |
|
Stephen Haberman
|
dd583b7ebf
|
Call executeOnCompleteCallbacks in a finally block.
|
2013-01-15 10:52:06 -06:00 |
|
Charles Reiss
|
b038999797
|
Fix accidental spark.master.host reuse
|
2013-01-14 17:04:44 -08:00 |
|
Charles Reiss
|
7ba34bc007
|
Additional tests for MapOutputTracker.
|
2013-01-14 15:27:02 -08:00 |
|
Charles Reiss
|
273fb5cc10
|
Throw FetchFailedException for cached missing locs
|
2013-01-14 15:26:48 -08:00 |
|
Matei Zaharia
|
cb867e9ffb
|
Merge branch 'master' of github.com:mesos/spark
|
2013-01-13 19:34:32 -08:00 |
|
Matei Zaharia
|
72408e8dfa
|
Make filter preserve partitioner info, since it can
|
2013-01-13 19:34:07 -08:00 |
|
Matei Zaharia
|
9a34409810
|
Merge pull request #360 from rxin/cogroup-java
Changed CoGroupRDD's hash map from Scala to Java.
|
2013-01-13 15:31:08 -08:00 |
|
Reynold Xin
|
be7166146b
|
Removed the use of getOrElse to avoid Scala wrapper for every call.
|
2013-01-13 15:27:28 -08:00 |
|
Mikhail Bautin
|
88d8f11365
|
Add missing dependency spray-json to Maven build
|
2013-01-13 00:46:25 -08:00 |
|
Matei Zaharia
|
fbb3fc4143
|
Merge pull request #346 from JoshRosen/python-api
Python API (PySpark)
|
2013-01-12 23:49:36 -08:00 |
|
Matei Zaharia
|
01413ca0e7
|
Merge pull request #364 from tysonjh/master
Executor and JobDescription JSON support added
|
2013-01-12 16:17:07 -08:00 |
|
Matei Zaharia
|
995075bf79
|
Merge pull request #355 from shivaram/default-hadoop-pom
Activate hadoop1 profile by default for maven builds
|
2013-01-12 15:38:36 -08:00 |
|
Shivaram Venkataraman
|
bbc56d85ed
|
Rename environment variable for hadoop profiles to hadoopVersion
|
2013-01-12 15:24:13 -08:00 |
|
Tyson
|
1731f1fed4
|
Added an optional format parameter for individual job queries and optimized the jobId query
|
2013-01-11 15:01:43 -05:00 |
|
Tyson
|
c063e8777e
|
Added implicit json writers for JobDescription and ExecutorRunner
|
2013-01-11 14:57:38 -05:00 |
|
Shivaram Venkataraman
|
9262522306
|
Activate hadoop2 profile in pom.xml with -Dhadoop=2
|
2013-01-10 22:07:34 -08:00 |
|
Matei Zaharia
|
2e914d9983
|
Formatting
|
2013-01-10 19:13:08 -08:00 |
|
Matei Zaharia
|
3548c9c0c8
|
Merge branch 'master' of github.com:mesos/spark
|
2013-01-10 19:06:40 -08:00 |
|
Matei Zaharia
|
6d1c230281
|
Merge pull request #357 from tysonjh/master
JSON support added to WebUI
|
2013-01-10 19:06:07 -08:00 |
|
Matei Zaharia
|
248995c535
|
Merge pull request #356 from shane-huang/master
Fix an issue in ConnectionManager where sendMessage may create too many unnecessary connections
|
2013-01-10 17:52:23 -08:00 |
|
Reynold Xin
|
bd336f5f40
|
Changed CoGroupRDD's hash map from Scala to Java.
|
2013-01-10 17:13:04 -08:00 |
|
shane-huang
|
9930a95d21
|
Modified Patch according to comments
|
2013-01-10 20:09:55 +08:00 |
|
Tyson
|
549ee388a1
|
Removed io.spray spray-json dependency as it is not needed.
|
2013-01-09 15:12:23 -05:00 |
|
Tyson
|
bf9d9946f9
|
Query parameter reformatted to be more extensible and routing more robust
|
2013-01-09 11:29:58 -05:00 |
|
Tyson
|
0da2ff102e
|
Added url query parameter json and handler
|
2013-01-09 10:40:48 -05:00 |
|
Tyson
|
269fe018c7
|
JSON object definitions
|
2013-01-09 10:40:43 -05:00 |
|
Matei Zaharia
|
9cc764f523
|
Code style
|
2013-01-08 22:29:57 -08:00 |
|
Matei Zaharia
|
14972141f9
|
Merge pull request #344 from mbautin/log_preferred_hosts
Log preferred hosts
|
2013-01-08 22:26:34 -08:00 |
|
Josh Rosen
|
b57dd0f160
|
Add mapPartitionsWithSplit() to PySpark.
|
2013-01-08 16:05:02 -08:00 |
|
Stephen Haberman
|
8ac0f35be4
|
Add JavaRDDLike.keyBy.
|
2013-01-08 09:57:45 -06:00 |
|
Stephen Haberman
|
4ee6b22775
|
Merge branch 'master' into tupleBy
Conflicts:
core/src/test/scala/spark/RDDSuite.scala
|
2013-01-08 09:10:10 -06:00 |
|
shane-huang
|
e4cb72da8a
|
Fix an issue in ConnectionManager where sendingMessage may create too many unnecessary SendingConnections.
|
2013-01-08 22:40:58 +08:00 |
|
Shivaram Venkataraman
|
f7adb382ac
|
Activate hadoop1 if property hadoop is missing. hadoop2 can be activated now
by using -Dhadoop -Phadoop2.
|
2013-01-08 03:19:43 -08:00 |
|
Mikhail Bautin
|
4725b0f643
|
Fixing if/else coding style for preferred hosts logging
|
2013-01-07 20:09:26 -08:00 |
|
Mikhail Bautin
|
c41042c816
|
Log preferred hosts
|
2013-01-07 20:06:09 -08:00 |
|
Shivaram Venkataraman
|
4bbe07e5ec
|
Activate hadoop1 profile by default for maven builds
|
2013-01-07 17:46:22 -08:00 |
|
Shivaram Venkataraman
|
b1336e2fe4
|
Update expected size of strings to match our dummy string class
|
2013-01-07 17:00:32 -08:00 |
|
Shivaram Venkataraman
|
55c66d365f
|
Use a dummy string class in Size Estimator tests to make it resistant to jdk
versions
|
2013-01-07 15:58:00 -08:00 |
|
Shivaram Venkataraman
|
77d751731c
|
Remove unused BoundedMemoryCache file and associated test case.
|
2013-01-07 15:57:46 -08:00 |
|
Shivaram Venkataraman
|
aed368a970
|
Update Hadoop dependency to 1.0.3 as 0.20 has Sun specific dependencies. Also
fix SequenceFileRDDFunctions to pick the right type conversion across Hadoop
versions
|
2013-01-07 15:57:33 -08:00 |
|
Shivaram Venkataraman
|
f8d579a0c0
|
Remove dependencies on sun jvm classes. Instead use reflection to infer
HotSpot options and total physical memory size
|
2013-01-07 15:57:18 -08:00 |
|
Matei Zaharia
|
1941d9602d
|
Merge branch 'master' of github.com:mesos/spark
|
2013-01-07 16:50:39 -05:00 |
|
Matei Zaharia
|
9c32f300fb
|
Add Accumulable.setValue for easier use in Java
|
2013-01-07 16:50:23 -05:00 |
|