Patrick Wendell
|
c99b674405
|
Merge pull request #735 from karenfeng/ui-807
Totals for shuffle data and CPU time
|
2013-07-29 16:32:55 -07:00 |
|
Karen Feng
|
2d6da9195a
|
Alphabetized imports
|
2013-07-29 15:50:52 -07:00 |
|
Reynold Xin
|
fe7298b587
|
Merge pull request #741 from pwendell/usability
Fix two small usability issues
|
2013-07-29 14:01:00 -07:00 |
|
Matei Zaharia
|
b9d6783f36
|
Optimize Python take() to not compute entire first partition
|
2013-07-29 02:51:43 -04:00 |
|
Karen Feng
|
077f2dad22
|
Fixed outdated bugs
|
2013-07-27 16:39:36 -07:00 |
|
Patrick Wendell
|
bcafb36c1e
|
Slight wording change
|
2013-07-27 16:03:50 -07:00 |
|
Patrick Wendell
|
8177165ac4
|
Log executor on finish
|
2013-07-27 16:02:06 -07:00 |
|
Patrick Wendell
|
c2223e6801
|
Improve catch scope and logging for client stop()
This does two things:
1. Catches the more general `TimeoutException`, since those can be thrown.
2. Logs at info level when a timeout is detected.
|
2013-07-27 16:02:06 -07:00 |
|
Karen Feng
|
5a93e3c58c
|
Cleaned up code based on pwendell's suggestions
|
2013-07-27 15:55:26 -07:00 |
|
Karen Feng
|
dcc4743a95
|
Moved val now to render
|
2013-07-27 12:52:53 -07:00 |
|
Karen Feng
|
1714693324
|
Current time called once with value now
|
2013-07-27 12:24:41 -07:00 |
|
Karen Feng
|
bd4cc52e30
|
Made metrics Option instead of Some, fixed NullPointerException
|
2013-07-26 17:23:18 -07:00 |
|
Reynold Xin
|
cb366774c8
|
Merge pull request #738 from harsha2010/pruning
Fix bug in Partition Pruning.
|
2013-07-26 16:59:30 -07:00 |
|
harshars
|
392d7474fd
|
Code review
|
2013-07-26 15:23:15 -07:00 |
|
harshars
|
72cf7ec0e5
|
Indentation
|
2013-07-26 15:16:41 -07:00 |
|
harshars
|
822aac8f5a
|
Indentation
|
2013-07-26 15:10:32 -07:00 |
|
harshars
|
743fc4e7aa
|
Fix Bug in Partition Pruning, index of Pruned Partitions should inherit from parent
|
2013-07-26 14:35:17 -07:00 |
|
Karen Feng
|
3fbe9eaac0
|
Displys shuffle read/write only if exists, wraps if statements, trims old vals, grabs current time once
|
2013-07-26 11:51:38 -07:00 |
|
Karen Feng
|
22faeab261
|
Split Shuffle Activity overview column for read/write
|
2013-07-25 17:14:18 -07:00 |
|
Karen Feng
|
d4bbc8bd25
|
Shows totals for shuffle data and CPU time in Stage, homepage overviews including active time
|
2013-07-25 15:59:52 -07:00 |
|
Charles Reiss
|
a6de90c927
|
For standalone mode, get JAVA_HOME, SPARK_JAVA_OPTS, SPARK_LIBRARY_PATH from application env, not worker env
|
2013-07-25 12:42:30 -07:00 |
|
ryanlecompte
|
e56aa75de0
|
fix wrapping
|
2013-07-24 22:08:09 -07:00 |
|
ryanlecompte
|
8e0939f5a9
|
refactor Kryo serializer support to use chill/chill-java
|
2013-07-24 20:43:57 -07:00 |
|
Karen Feng
|
57009eef90
|
Fixed consistency of "success" status string
|
2013-07-24 13:43:09 -07:00 |
|
Karen Feng
|
4280e1768d
|
Removed finished status for task info, changed name of success case
|
2013-07-24 12:48:48 -07:00 |
|
Karen Feng
|
bd3931c874
|
Changed ifs with returns to if/else
|
2013-07-24 11:27:17 -07:00 |
|
Karen Feng
|
93c6015f82
|
Shows task status and running tasks on Stage Page: fixes SPARK-804 and 811
|
2013-07-24 10:53:02 -07:00 |
|
jerryshao
|
31ec72b243
|
Code refactor according to comments
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
8d1ef7f2df
|
Code style changes
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
05637de842
|
Change class xxxInstrumentation to class xxxSource
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
ed1a3bc206
|
continue to refactor code style and functions
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
5730193e0c
|
Fix some typos
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
a79f6077f0
|
Add Maven metrics library dependency and code changes
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
1daff54b2e
|
Change Executor MetricsSystem initialize code to SparkEnv
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
5f8802c1fb
|
Register and init metricsSystem in SparkContext
Conflicts:
core/src/main/scala/spark/SparkContext.scala
core/src/main/scala/spark/SparkEnv.scala
|
2013-07-24 14:57:47 +08:00 |
|
Andrew xia
|
7d2eada451
|
Add metrics source of DAGScheduler and blockManager
Conflicts:
core/src/main/scala/spark/SparkContext.scala
core/src/main/scala/spark/SparkEnv.scala
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
e9ac88754d
|
Remove twice add Source bug and code clean
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
5ce5dc9fcd
|
Add default properties to deal with no configure file situation
|
2013-07-24 14:57:47 +08:00 |
|
jerryshao
|
871bc1687e
|
Add Executor instrumentation
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
7fb574bf66
|
Code clean and remarshal
|
2013-07-24 14:57:46 +08:00 |
|
Andrew xia
|
4d6dd67fa1
|
refactor metrics system
1.change source abstract class to support MetricRegistry
2.change master/work/jvm source class
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
03f9871116
|
MetricsSystem refactor
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
c3daad3f65
|
Update metric source support for instrumentation
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
9dec8c73e6
|
Add Master and Worker instrumentation support
|
2013-07-24 14:57:46 +08:00 |
|
jerryshao
|
503acd3a37
|
Build metrics system framwork
|
2013-07-24 14:57:46 +08:00 |
|
Matei Zaharia
|
b011329040
|
Merge pull request #727 from rxin/scheduler
Scheduler code style cleanup.
|
2013-07-23 22:50:09 -07:00 |
|
Matei Zaharia
|
876125b997
|
Merge pull request #726 from rxin/spark-826
SPARK-829: scheduler shouldn't hang if a task contains unserializable objects in its closure
|
2013-07-23 22:28:21 -07:00 |
|
Reynold Xin
|
3dae1df66f
|
Moved non-serializable closure catching exception from submitStage to submitMissingTasks
|
2013-07-23 20:29:07 -07:00 |
|
Reynold Xin
|
d33b8a2a0f
|
Added comments on task closure serialization.
|
2013-07-23 20:28:39 -07:00 |
|
Reynold Xin
|
85ab8114bc
|
Moved non-serializable closure catching exception from submitStage to submitMissingTasks
|
2013-07-23 20:25:58 -07:00 |
|