ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/core/src/main/scala/spark
History
Charles Reiss d21ca010ac Add block manager heart beats. 
Renames old message called 'HeartBeat' to 'BlockUpdate'.

The BlockManager periodically sends a heart beat message to the master.
If the manager is currently not registered. The master responds to the
heart beat by indicating whether the BlockManager is currently registered
with the master. Additionally, the master now also responds to block
updates by indicating whether the BlockManager in question is registered.
When the BlockManager detects (by heart beat or failed block update)
that it stopped being registered, it reregisters and sends block
updates for all its blocks.
2012-12-05 23:35:20 -08:00
..
api/java Added zip to Java API 2012-11-27 22:38:09 -08:00
broadcast Conflict fixed 2012-10-02 22:25:39 -07:00
deploy Use external addresses in standalone WebUI on EC2. 2012-12-01 18:19:13 -08:00
executor Set default uncaught exception handler to exit. 2012-11-16 20:12:31 -08:00
network Fix for connections not being reused (from Josh Rosen) 2012-11-08 09:53:40 -08:00
partial Make more stuff private[spark] 2012-10-02 22:28:55 -07:00
rdd Merge pull request #313 from rxin/pde_size_compress 2012-11-27 22:39:25 -08:00
scheduler Fix NullPointerException caused by unregistered map outputs. 2012-11-27 20:51:51 -08:00
serializer More doc updates, and moved Serializer to a subpackage. 2012-10-12 18:19:21 -07:00
storage Add block manager heart beats. 2012-12-05 23:35:20 -08:00
util Fix K-means example a little 2012-11-10 23:07:21 -08:00
Accumulators.scala Some doc and usability improvements: 2012-10-12 17:53:20 -07:00
Aggregator.scala Remove mapSideCombine field from Aggregator. 2012-10-13 14:59:20 -07:00
BlockStoreShuffleFetcher.scala Change ShuffleFetcher to return an Iterator. 2012-10-13 14:59:20 -07:00
BoundedMemoryCache.scala Make classes package private 2012-10-02 19:00:19 -07:00
Cache.scala Make classes package private 2012-10-02 19:00:19 -07:00
CacheTracker.scala Change block manager to accept a ArrayBuffer instead of an iterator to ensure 2012-10-11 00:42:46 -07:00
ClosureCleaner.scala Make classes package private 2012-10-02 19:00:19 -07:00
DaemonThreadFactory.scala Ported performance and FT improvements from latest streaming work 2012-09-12 14:54:40 -07:00
Dependency.scala Merge remote-tracking branch 'JoshRosen/shuffle_refactoring' into dev 2012-10-23 22:01:45 -07:00
DoubleRDDFunctions.scala Added documentation to all the *RDDFunction classes, and moved them into 2012-10-09 18:38:36 -07:00
FetchFailedException.scala Make classes package private 2012-10-02 19:00:19 -07:00
HadoopWriter.scala Support for Hadoop 2 distributions such as cdh4 2012-10-18 16:08:54 -07:00
HttpFileServer.scala Make classes package private 2012-10-02 19:00:19 -07:00
HttpServer.scala Make classes package private 2012-10-02 19:00:19 -07:00
JavaSerializer.scala More doc updates, and moved Serializer to a subpackage. 2012-10-12 18:19:21 -07:00
KryoSerializer.scala More doc updates, and moved Serializer to a subpackage. 2012-10-12 18:19:21 -07:00
Logging.scala Scaladoc documentation for some core Spark functionality 2012-10-04 22:59:36 -07:00
MapOutputTracker.scala Merge branch 'master' of github.com:mesos/spark 2012-11-27 20:51:58 -08:00
package.scala Scaladoc documentation for some core Spark functionality 2012-10-04 22:59:36 -07:00
PairRDDFunctions.scala Merge remote-tracking branch 'JoshRosen/shuffle_refactoring' into dev 2012-10-23 22:01:45 -07:00
ParallelCollection.scala More doc updates, and moved Serializer to a subpackage. 2012-10-12 18:19:21 -07:00
Partitioner.scala More doc updates, and moved Serializer to a subpackage. 2012-10-12 18:19:21 -07:00
RDD.scala Merge pull request #313 from rxin/pde_size_compress 2012-11-27 22:39:25 -08:00
SequenceFileRDDFunctions.scala Added documentation to all the *RDDFunction classes, and moved them into 2012-10-09 18:38:36 -07:00
SerializableWritable.scala Fix issue #65: Change @serializable to extends Serializable in 2.9 branch 2011-08-02 10:16:33 +01:00
ShuffleFetcher.scala Change ShuffleFetcher to return an Iterator. 2012-10-13 14:59:20 -07:00
SizeEstimator.scala Make classes package private 2012-10-02 19:00:19 -07:00
SoftReferenceCache.scala Make classes package private 2012-10-02 19:00:19 -07:00
SparkContext.scala Strip leading mesos:// in URLs passed to Mesos 2012-10-24 21:52:13 -07:00
SparkEnv.scala Set default uncaught exception handler to exit. 2012-11-16 20:12:31 -08:00
SparkException.scala Upgraded to Akka 2 and fixed test execution (which was still parallel 2012-06-28 23:51:28 -07:00
Split.scala Various code style fixes, mostly from IntelliJ IDEA 2012-06-29 18:47:12 -07:00
TaskContext.scala Some refactoring to make cluster scheduler pluggable. 2012-07-06 15:23:26 -07:00
TaskEndReason.scala Stylistic changes and Public Accumulable and Broadcast 2012-10-02 19:28:37 -07:00
TaskState.scala Make classes package private 2012-10-02 19:00:19 -07:00
Utils.scala Addressing Matei's comment: SPARK_LOCAL_IP environment variable 2012-11-19 11:52:10 -08:00