Reynold Xin
|
8c01295b85
|
Fixed conflicts from merging Charles' and TD's block manager changes.
|
2012-12-14 00:26:36 -08:00 |
|
Matei Zaharia
|
1072f970cc
|
Merge pull request #331 from woggling/deploy-exit-status
Have standalone cluster report exit codes to clients
|
2012-12-13 22:43:48 -08:00 |
|
Charles Reiss
|
c528932a41
|
Code review cleanup.
|
2012-12-13 22:37:16 -08:00 |
|
Charles Reiss
|
0aad42b5e7
|
Have standalone cluster report exit codes to clients. Addresses SPARK-639.
|
2012-12-13 22:37:16 -08:00 |
|
Reynold Xin
|
0235667f73
|
Merge branch 'master' of github.com:mesos/spark into spark-633
|
2012-12-13 22:33:41 -08:00 |
|
Reynold Xin
|
97434f49b8
|
Merged TD's block manager refactoring.
|
2012-12-13 22:32:19 -08:00 |
|
Matei Zaharia
|
d6d910471d
|
Merge pull request #333 from rxin/master
Fixed the broken Java unit test from SPARK-635.
|
2012-12-13 22:31:53 -08:00 |
|
Reynold Xin
|
f4a9e1b9be
|
Fixed the broken Java unit test from SPARK-635.
|
2012-12-13 22:22:12 -08:00 |
|
Reynold Xin
|
41e58a519a
|
Merge branch 'master' of github.com:mesos/spark into spark-633
|
2012-12-13 22:06:47 -08:00 |
|
Josh Rosen
|
cf52d9cade
|
Add try-finally to handle MapOutputTracker timeouts.
|
2012-12-13 21:53:30 -08:00 |
|
Matei Zaharia
|
05e225f988
|
Merge pull request #329 from woggling/executor-status-codes
Executor exit status codes
|
2012-12-13 20:14:10 -08:00 |
|
Charles Reiss
|
b054d3b222
|
ExecutorLostReason -> ExecutorLossReason
|
2012-12-13 18:44:07 -08:00 |
|
Charles Reiss
|
24d7aa2d15
|
Extra whitespace in ExecutorExitCode
|
2012-12-13 18:39:23 -08:00 |
|
Matei Zaharia
|
012aa4e3d4
|
Merge pull request #330 from JoshRosen/spark-638
Use spark-env.sh to configure standalone master
|
2012-12-13 18:05:32 -08:00 |
|
Josh Rosen
|
1948f46093
|
Use spark-env.sh to configure standalone master. See SPARK-638.
Also fixed a typo in the standalone mode documentation.
|
2012-12-14 01:20:00 +00:00 |
|
Reynold Xin
|
dc7d7fc286
|
Merge branch 'master' of github.com:mesos/spark into spark-633
|
2012-12-13 16:48:34 -08:00 |
|
Matei Zaharia
|
dfcbb2ad97
|
Merge pull request #328 from rxin/spark-635
SPARK-635: Pass a TaskContext object to compute() interface and use that to close Hadoop input stream.
|
2012-12-13 16:46:54 -08:00 |
|
Reynold Xin
|
4f076e105e
|
SPARK-635: Pass a TaskContext object to compute() interface and use
that to close Hadoop input stream. Incorporated Matei's command.
|
2012-12-13 16:41:15 -08:00 |
|
Charles Reiss
|
829206f1a7
|
Explain slaveLost calls made by StandaloneSchedulerBackend
|
2012-12-13 16:23:36 -08:00 |
|
Charles Reiss
|
a4041dd87f
|
Log duplicate slaveLost() calls in ClusterScheduler.
|
2012-12-13 16:23:36 -08:00 |
|
Charles Reiss
|
fa9df4a45d
|
Normalize executor exit statuses and report them to the user.
|
2012-12-13 16:23:31 -08:00 |
|
Reynold Xin
|
eacb98e900
|
SPARK-635: Pass a TaskContext object to compute() interface and use that
to close Hadoop input stream.
|
2012-12-13 15:41:53 -08:00 |
|
Josh Rosen
|
7c9e3d1c21
|
Return success or failure in BlockStore.remove().
|
2012-12-13 15:22:27 -08:00 |
|
Matei Zaharia
|
8fd374dfb2
|
Merge pull request #325 from tomdz/master
Mark hadoop dependencies provided in all library artifacts
|
2012-12-13 12:44:20 -08:00 |
|
Reynold Xin
|
1b7a0451ed
|
Added the ability in block manager to remove blocks.
|
2012-12-13 00:04:42 -08:00 |
|
Charles Reiss
|
1d8e2e6cff
|
Call slaveLost on executor death for standalone clusters.
|
2012-12-12 21:15:34 -08:00 |
|
Tathagata Das
|
8e74fac215
|
Made checkpoint data in RDDs optional to further reduce serialized size.
|
2012-12-11 15:36:12 -08:00 |
|
Tathagata Das
|
fa28f25619
|
Fixed bug in UnionRDD and CoGroupedRDD
|
2012-12-11 13:59:43 -08:00 |
|
Matei Zaharia
|
391e5a194a
|
Merge pull request #323 from admobius/master
SPARK-626: Remove security groups properly
|
2012-12-11 12:01:42 -08:00 |
|
Peter Sankauskas
|
f97ce3ae14
|
SPARK-626: Making security group deletion optional, handling retried
when deleting security groups fails, fixing bug when using all zones but
only 1 slave.
|
2012-12-11 10:48:21 -08:00 |
|
Tathagata Das
|
2a87d816a2
|
Added clear property to JavaAPISuite to remove port binding errors.
|
2012-12-11 01:44:43 -08:00 |
|
Tathagata Das
|
746afc2e65
|
Bunch of bug fixes related to checkpointing in RDDs. RDDCheckpointData object is used to lock all serialization and dependency changes for checkpointing. ResultTask converted to Externalizable and serialized RDD is cached like ShuffleMapTask.
|
2012-12-10 23:36:37 -08:00 |
|
Thomas Dudziak
|
02d64f9662
|
Mark hadoop dependencies provided in all library artifacts
|
2012-12-10 21:27:54 -08:00 |
|
Matei Zaharia
|
75b8d1f870
|
Merge pull request #324 from rxin/master
Suppress shuffle block updates when a slave node comes back.
|
2012-12-10 20:39:08 -08:00 |
|
Reynold Xin
|
21b271f5bd
|
Suppress shuffle block updates when a slave node comes back.
|
2012-12-10 20:36:03 -08:00 |
|
Peter Sankauskas
|
9f964612a1
|
SPARK-626: Remove rules before removing security groups, with a pause in
between so wait for AWS eventual consistency to catch up.
|
2012-12-10 17:44:09 -08:00 |
|
Matei Zaharia
|
c10b229992
|
Merge pull request #319 from mbautin/cdh4.1.2
Bump CDH version for the Hadoop 2 profile to 4.1.2
|
2012-12-10 15:21:01 -08:00 |
|
Matei Zaharia
|
1ae8978298
|
Merge pull request #320 from tomdz/master
Shaded repl jar for hadoop1 profile needs to include hadoop classes
|
2012-12-10 15:15:10 -08:00 |
|
Matei Zaharia
|
01c1f97e95
|
Make "run" script work with Maven builds
|
2012-12-10 15:13:16 -08:00 |
|
Matei Zaharia
|
597520ae20
|
Make sure the SSH key we copy to EC2 has permissions 600.
SPARK-539 #resolve
|
2012-12-10 15:12:06 -08:00 |
|
Thomas Dudziak
|
c1d15ae3d5
|
Shaded repl jar for hadoop1 profile needs to include hadoop classes
|
2012-12-10 15:06:28 -08:00 |
|
Mikhail Bautin
|
450659079a
|
Bump CDH version for the Hadoop 2 profile to 4.1.2
|
2012-12-10 11:27:20 -08:00 |
|
Matei Zaharia
|
a1a2daa7ef
|
Merge pull request #317 from woggling/block-manager-heartbeat
Implement block manager heartbeat
|
2012-12-10 11:03:55 -08:00 |
|
Matei Zaharia
|
a9ea14d6e7
|
Merge pull request #318 from tomdz/master
Minor tweaks to the debian build
|
2012-12-10 10:59:41 -08:00 |
|
Matei Zaharia
|
ccff0a089a
|
Use the same output directories that SBT had in subprojects
This will make it easier to make the "run" script work with a Maven build
|
2012-12-10 10:58:56 -08:00 |
|
Thomas Dudziak
|
0e5b1f7981
|
Minor tweaks to the debian build
|
2012-12-10 10:30:30 -08:00 |
|
Charles Reiss
|
b6b62d774f
|
Decrease BlockManagerMaster logging verbosity
|
2012-12-10 00:31:55 -08:00 |
|
Charles Reiss
|
5d3e917d09
|
Use Akka scheduler for BlockManager heart beats.
Adds required ActorSystem argument to BlockManager constructors.
|
2012-12-10 00:31:50 -08:00 |
|
Charles Reiss
|
b53dd28c90
|
Changed default block manager heartbeat interval to 5 s
|
2012-12-09 23:03:34 -08:00 |
|
Matei Zaharia
|
beb440089e
|
Merge pull request #310 from tomdz/master-mavenized
Maven build setup
|
2012-12-09 21:40:05 -08:00 |
|