Stephen Haberman
|
4fe1fbdd51
|
Remove unused addIfNoPort.
|
2013-05-28 16:26:32 -05:00 |
|
Matei Zaharia
|
3db1e17baa
|
Merge pull request #620 from jerryshao/master
Fix CheckpointRDD java.io.FileNotFoundException when calling getPreferredLocations
|
2013-05-27 21:31:43 -07:00 |
|
Matei Zaharia
|
e8d4b6c296
|
Merge pull request #529 from xiajunluan/master
[SPARK-663]Implement Fair Scheduler in Spark Cluster Scheduler
|
2013-05-25 21:09:03 -07:00 |
|
Reynold Xin
|
26962c9340
|
Automatically configure Netty port. This makes unit tests using
local-cluster pass. Previously they were failing because Netty was
trying to bind to the same port for all processes.
Pair programmed with @shivaram.
|
2013-05-24 16:39:33 -07:00 |
|
Reynold Xin
|
6ea085169d
|
Fixed the bug that shuffle serializer is ignored by the new shuffle
block iterators for local blocks. Also added a unit test for that.
|
2013-05-24 14:08:37 -07:00 |
|
jerryshao
|
bd3ea8f2a6
|
fix CheckpointRDD getPreferredLocations java.io.FileNotFoundException
|
2013-05-24 14:26:19 +08:00 |
|
Charles Reiss
|
f350f14084
|
Use ARRAY_SAMPLE_SIZE constant instead of 100.0
|
2013-05-21 18:11:33 -07:00 |
|
Andrew xia
|
ecd6d75c6a
|
fix bug of unit tests
|
2013-05-21 06:49:23 +08:00 |
|
Reynold Xin
|
5912cc4967
|
Merge pull request #610 from JoshRosen/spark-747
Throw exception if TaskResult exceeds Akka frame size
|
2013-05-17 19:58:40 -07:00 |
|
Reynold Xin
|
8d78c5f89f
|
Changed the logging level from info to warning when addJar(null) is
called.
|
2013-05-17 18:51:35 -07:00 |
|
Andrew xia
|
3d4672eaa9
|
Merge branch 'master' into xiajunluan
Conflicts:
core/src/main/scala/spark/SparkContext.scala
core/src/main/scala/spark/scheduler/cluster/ClusterScheduler.scala
core/src/main/scala/spark/scheduler/cluster/TaskSetManager.scala
|
2013-05-18 07:28:03 +08:00 |
|
Andrew xia
|
d19753b9c7
|
expose TaskSetManager type to resourceOffer function in ClusterScheduler
|
2013-05-18 06:45:19 +08:00 |
|
Andrew xia
|
c6e2770bfe
|
Fix ClusterScheduler bug to avoid allocating tasks to same slave
|
2013-05-17 05:10:38 +08:00 |
|
Mridul Muralidharan
|
f0881f8d48
|
Hope this does not turn into a bike shed change
|
2013-05-17 01:58:50 +05:30 |
|
Mridul Muralidharan
|
feddd2530d
|
Filter out nulls - prevent NPE
|
2013-05-16 17:49:14 +05:30 |
|
Josh Rosen
|
b8e46b6074
|
Abort job if result exceeds Akka frame size; add test.
|
2013-05-16 01:57:57 -07:00 |
|
Matei Zaharia
|
2f576aba8f
|
Merge pull request #602 from rxin/shufflemerge
Manual merge & cleanup of Shane's Shuffle Performance Optimization
|
2013-05-15 18:06:24 -07:00 |
|
Reynold Xin
|
203d7b7c14
|
Merge pull request #593 from squito/driver_ui_link
Master UI has link to Application UI
|
2013-05-15 00:47:20 -07:00 |
|
Reynold Xin
|
f3491cb89b
|
Merge branch 'master' of github.com:mesos/spark into shufflemerge
Conflicts:
core/src/main/scala/spark/storage/BlockManager.scala
core/src/test/scala/spark/DistributedSuite.scala
project/SparkBuild.scala
|
2013-05-15 00:31:52 -07:00 |
|
Reynold Xin
|
f9d40a5848
|
Added a comment in JdbcRDD for example usage.
|
2013-05-14 23:29:57 -07:00 |
|
Reynold Xin
|
81ad2fa331
|
Merge branch 'jdbc' of github.com:koeninger/spark
Conflicts:
project/SparkBuild.scala
|
2013-05-14 23:12:00 -07:00 |
|
Matei Zaharia
|
016ac86830
|
Merge pull request #601 from rxin/emptyrdd-master
EmptyRDD (master branch 0.8)
|
2013-05-13 21:45:36 -07:00 |
|
Matei Zaharia
|
4b354e0a08
|
Merge pull request #589 from mridulm/master
Add support for instance local scheduling
|
2013-05-13 17:39:19 -07:00 |
|
Patrick Wendell
|
7f0833647b
|
Capturing class name
|
2013-05-12 07:54:03 -07:00 |
|
Patrick Wendell
|
72b9c4cb6e
|
Small fix
|
2013-05-11 23:53:50 -07:00 |
|
Patrick Wendell
|
1c15b85051
|
Removing import
|
2013-05-11 23:52:53 -07:00 |
|
Patrick Wendell
|
059ab88754
|
Changing technique to use same code path in all cases
|
2013-05-11 23:50:54 -07:00 |
|
Cody Koeninger
|
3da2305ed0
|
code cleanup per rxin comments
|
2013-05-11 23:59:07 -05:00 |
|
Josh Rosen
|
440719109e
|
Throw exception if task result exceeds Akka frame size.
This partially addresses SPARK-747.
|
2013-05-11 19:17:13 -07:00 |
|
Patrick Wendell
|
0345954530
|
SPARK-738: Spark should detect and squash nonserializable exceptions
|
2013-05-11 14:17:09 -07:00 |
|
Mark Hamstra
|
6e6b3e0d7e
|
Actually use the cleaned closure in foreachPartition
|
2013-05-10 13:02:34 -07:00 |
|
Imran Rashid
|
0ab818d508
|
fix linebreak
|
2013-05-09 00:38:59 -07:00 |
|
Reynold Xin
|
5d70ee4663
|
Cleaned up connection manager (moved many classes to their own files).
|
2013-05-07 22:42:15 -07:00 |
|
Reynold Xin
|
8388e8dd7a
|
Minor style fix in DiskStore...
|
2013-05-07 18:40:35 -07:00 |
|
Reynold Xin
|
547dcbe494
|
Cleaned up Scala files in network/netty from Shane's PR.
|
2013-05-07 18:39:33 -07:00 |
|
Reynold Xin
|
9e64396ca4
|
Cleaned up the Java files from Shane's PR.
|
2013-05-07 18:30:54 -07:00 |
|
Reynold Xin
|
0e5cc30868
|
Cleaned up BlockManager and BlockFetcherIterator from Shane's PR.
|
2013-05-07 18:18:24 -07:00 |
|
Reynold Xin
|
8b79485171
|
Moved BlockFetcherIterator to its own file.
|
2013-05-07 17:02:32 -07:00 |
|
Reynold Xin
|
90577ada69
|
Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark into shufflemerge
Conflicts:
core/src/main/scala/spark/storage/BlockManager.scala
core/src/main/scala/spark/storage/DiskStore.scala
project/SparkBuild.scala
|
2013-05-07 15:56:19 -07:00 |
|
Reynold Xin
|
0fd84965f6
|
Added EmptyRDD.
|
2013-05-06 15:40:34 -07:00 |
|
Imran Rashid
|
22a5063ae4
|
switch from separating appUI host & port to combining into just appUiUrl
|
2013-05-05 12:19:11 -07:00 |
|
Matei Zaharia
|
7af92f248b
|
Merge pull request #597 from JoshRosen/webui-fixes
Two minor bug fixes for Spark Web UI
|
2013-05-04 22:29:17 -07:00 |
|
Josh Rosen
|
42b1953c53
|
Fix SPARK-630: app details page shows finished executors as running.
|
2013-05-04 18:34:47 -07:00 |
|
Josh Rosen
|
d48e9fde01
|
Fix SPARK-629: weird number of cores in job details page.
|
2013-05-04 18:34:45 -07:00 |
|
Mridul Muralidharan
|
25198d7e9e
|
Merge branch 'master' of github.com:mridulm/spark
|
2013-05-04 20:45:56 +05:30 |
|
Mridul Muralidharan
|
5b011d18d7
|
Merge from master
|
2013-05-04 20:41:27 +05:30 |
|
Mridul Muralidharan
|
edb57c8331
|
Add support for instance local in getPreferredLocations of ZippedPartitionsBaseRDD. Add comments to both ZippedPartitionsBaseRDD and ZippedRDD to better describe the potential problem with the approach
|
2013-05-04 19:47:45 +05:30 |
|
Matei Zaharia
|
3bf2c868c3
|
Merge pull request #594 from shivaram/master
Add zip partitions to Java API
|
2013-05-03 18:27:30 -07:00 |
|
Shivaram Venkataraman
|
bb8a434f9d
|
Add zipPartitions to Java API.
|
2013-05-03 15:14:02 -07:00 |
|
Imran Rashid
|
6fae936088
|
applications (aka drivers) send their webUI address to master when registering so it can be displayed in the master web ui
|
2013-05-03 12:59:10 -07:00 |
|