Matei Zaharia
|
5584ebcbd3
|
Merge pull request #675 from c0s/assembly
Building spark assembly for further consumption of the Spark project with a deployed cluster
|
2013-07-24 11:46:46 -07:00 |
|
Karen Feng
|
bd3931c874
|
Changed ifs with returns to if/else
|
2013-07-24 11:27:17 -07:00 |
|
Karen Feng
|
93c6015f82
|
Shows task status and running tasks on Stage Page: fixes SPARK-804 and 811
|
2013-07-24 10:53:02 -07:00 |
|
Matei Zaharia
|
a73f3ee536
|
Merge pull request #671 from jerryshao/master
Add metrics system for Spark
|
2013-07-24 08:59:14 -07:00 |
|
jerryshao
|
31ec72b243
|
Code refactor according to comments
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
8d1ef7f2df
|
Code style changes
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
05637de842
|
Change class xxxInstrumentation to class xxxSource
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
5b4a2f2094
|
Add metrics config template file
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
ed1a3bc206
|
continue to refactor code style and functions
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
5730193e0c
|
Fix some typos
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
a79f6077f0
|
Add Maven metrics library dependency and code changes
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
1daff54b2e
|
Change Executor MetricsSystem initialize code to SparkEnv
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
5f8802c1fb
|
Register and init metricsSystem in SparkContext
Conflicts:
core/src/main/scala/spark/SparkContext.scala
core/src/main/scala/spark/SparkEnv.scala
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
9cea0c2818
|
Refactor metricsSystem unit test, add resource files.
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
7d2eada451
|
Add metrics source of DAGScheduler and blockManager
Conflicts:
core/src/main/scala/spark/SparkContext.scala
core/src/main/scala/spark/SparkEnv.scala
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
e9ac88754d
|
Remove twice add Source bug and code clean
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
e080588f73
|
Add metrics system unit test
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
5ce5dc9fcd
|
Add default properties to deal with no configure file situation
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
871bc1687e
|
Add Executor instrumentation
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
576528f0f9
|
Add dependency of Codahale's metrics library
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
7fb574bf66
|
Code clean and remarshal
|
2013-07-24 14:57:46 +08:00 |
|
Andrew xia
|
4d6dd67fa1
|
refactor metrics system
1.change source abstract class to support MetricRegistry
2.change master/work/jvm source class
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
03f9871116
|
MetricsSystem refactor
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
c3daad3f65
|
Update metric source support for instrumentation
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
9dec8c73e6
|
Add Master and Worker instrumentation support
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
503acd3a37
|
Build metrics system framwork
|
2013-07-24 14:57:46 +08:00 |
|
Matei Zaharia
|
b011329040
|
Merge pull request #727 from rxin/scheduler
Scheduler code style cleanup.
|
2013-07-23 22:50:09 -07:00 |
|
Matei Zaharia
|
876125b997
|
Merge pull request #726 from rxin/spark-826
SPARK-829: scheduler shouldn't hang if a task contains unserializable objects in its closure
|
2013-07-23 22:28:21 -07:00 |
|
Reynold Xin
|
3dae1df66f
|
Moved non-serializable closure catching exception from submitStage to submitMissingTasks
|
2013-07-23 20:29:07 -07:00 |
|
Reynold Xin
|
d33b8a2a0f
|
Added comments on task closure serialization.
|
2013-07-23 20:28:39 -07:00 |
|
Reynold Xin
|
85ab8114bc
|
Moved non-serializable closure catching exception from submitStage to submitMissingTasks
|
2013-07-23 20:25:58 -07:00 |
|
Matei Zaharia
|
6a31b7191d
|
Small bug fix
|
2013-07-23 16:20:24 -07:00 |
|
Matei Zaharia
|
2f1736c396
|
Merge pull request #725 from karenfeng/task-start
Creates task start events
|
2013-07-23 15:53:30 -07:00 |
|
Karen Feng
|
abc78cd331
|
Modifies instead of copies HashSets, fixes comment style
|
2013-07-23 15:47:16 -07:00 |
|
Karen Feng
|
383684daaa
|
Replaces Seq with HashSet, removes redundant import
|
2013-07-23 15:33:27 -07:00 |
|
Reynold Xin
|
f2422d4f29
|
SPARK-829: scheduler shouldn't hang if a task contains unserializable objects in its closure.
|
2013-07-23 15:30:20 -07:00 |
|
Reynold Xin
|
5ed38b4d1d
|
Scheduler code style cleanup.
|
2013-07-23 15:28:59 -07:00 |
|
Reynold Xin
|
101b8cc78a
|
SPARK-829: scheduler shouldn't hang if a task contains unserializable objects in its closure.
|
2013-07-23 15:28:20 -07:00 |
|
Dmitriy Lyubimov
|
72bac09c42
|
Leaking spark context in the test
|
2013-07-23 15:19:07 -07:00 |
|
Karen Feng
|
9f2dbb2a7c
|
Adds/removes active tasks only once
|
2013-07-23 15:10:09 -07:00 |
|
Dmitriy Lyubimov
|
ef82ff8564
|
Merge branch 'master' into SPARK-826
Conflicts:
core/src/main/scala/spark/scheduler/local/LocalScheduler.scala
|
2013-07-23 13:43:00 -07:00 |
|
shivaram
|
5364f645c5
|
Merge pull request #723 from rxin/mllib
Made RegressionModel serializable and added unit tests to make sure predict methods would work.
|
2013-07-23 13:40:34 -07:00 |
|
Karen Feng
|
0200801a55
|
Tracks task start events and shows number of active tasks on Executor UI
|
2013-07-23 13:35:43 -07:00 |
|
Dmitriy Lyubimov
|
310e73d566
|
style
|
2013-07-23 13:23:25 -07:00 |
|
Matei Zaharia
|
f369e0e51b
|
Merge pull request #720 from ooyala/2013-07/persistent-rdds-api
Add a public method getCachedRdds to SparkContext
|
2013-07-23 13:22:27 -07:00 |
|
Dmitriy Lyubimov
|
ac60d06381
|
Re-working in terms of changes to TaskSetManager. Verified with Standalone and Local mode.
|
2013-07-23 13:13:19 -07:00 |
|
Reynold Xin
|
2210e8ccf8
|
Use a different validation dataset for Logistic Regression prediction testing.
|
2013-07-23 12:52:15 -07:00 |
|
Reynold Xin
|
87a9dd898f
|
Made RegressionModel serializable and added unit tests to make sure predict methods would work.
|
2013-07-23 12:13:27 -07:00 |
|
Evan Chan
|
efd6418c1b
|
Move getPersistentRDDs testing to a new Suite
|
2013-07-23 10:40:41 -07:00 |
|
Evan Chan
|
4830e22562
|
Rename method per rxin feedback
|
2013-07-23 09:50:13 -07:00 |
|