ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/core/src/main/scala/spark
History
Stephen Haberman 28e0cb9f31 Fix createActorSystem not actually using the systemName parameter. 
This meant all system names were "spark", which worked, but didn't
lead to the most intuitive log output.

This fixes createActorSystem to use the passed system name, and
refactors Master/Worker to encapsulate their system/actor names
instead of having the clients guess at them.

Note that the driver system name, "spark", is left as is, and is
still repeated a few times, but that seems like a separate issue.
2013-02-02 01:11:37 -06:00
..
api Small fix from last commit 2013-01-31 21:52:52 -08:00
broadcast Replace old 'master' term with 'driver'. 2013-01-25 11:03:00 -06:00
deploy Fix createActorSystem not actually using the systemName parameter. 2013-02-02 01:11:37 -06:00
executor Merge pull request #428 from woggling/mesos-exec-id 2013-01-30 15:01:46 -08:00
network Remember ConnectionManagerId used to initiate SendingConnections. 2013-01-29 18:13:59 -08:00
partial Reduced the memory usage of reduce and similar operations 2013-02-01 15:38:42 -08:00
rdd Moved PruneDependency into PartitionPruningRDD.scala. 2013-02-01 00:02:46 -08:00
scheduler Reduced the memory usage of reduce and similar operations 2013-02-01 15:38:42 -08:00
serializer More doc updates, and moved Serializer to a subpackage. 2012-10-12 18:19:21 -07:00
storage Fix createActorSystem not actually using the systemName parameter. 2013-02-02 01:11:37 -06:00
util Fix createActorSystem not actually using the systemName parameter. 2013-02-02 01:11:37 -06:00
Accumulators.scala Minor cleanup. 2013-01-21 15:55:46 -06:00
Aggregator.scala Remove mapSideCombine field from Aggregator. 2012-10-13 14:59:20 -07:00
BlockStoreShuffleFetcher.scala Change ShuffleFetcher to return an Iterator. 2012-10-13 14:59:20 -07:00
Cache.scala Make classes package private 2012-10-02 19:00:19 -07:00
CacheManager.scala Simplify checkpointing code and RDD class a little: 2013-01-28 22:30:12 -08:00
ClosureCleaner.scala Make classes package private 2012-10-02 19:00:19 -07:00
Dependency.scala Moved PruneDependency into PartitionPruningRDD.scala. 2013-02-01 00:02:46 -08:00
DoubleRDDFunctions.scala Added documentation to all the *RDDFunction classes, and moved them into 2012-10-09 18:38:36 -07:00
FetchFailedException.scala Make classes package private 2012-10-02 19:00:19 -07:00
HadoopWriter.scala Support for Hadoop 2 distributions such as cdh4 2012-10-18 16:08:54 -07:00
HttpFileServer.scala Don't download files to master's working directory. 2013-01-21 17:34:17 -08:00
HttpServer.scala Fix for hanging spark.HttpFileServer with kind of virtual network 2013-01-22 23:08:34 +09:00
JavaSerializer.scala More doc updates, and moved Serializer to a subpackage. 2012-10-12 18:19:21 -07:00
KryoSerializer.scala Fix compile error due to cherry-pick 2013-01-23 13:07:27 -08:00
Logging.scala Minor cleanup. 2013-01-21 15:55:46 -06:00
MapOutputTracker.scala Add more private declarations. 2013-01-31 17:18:33 -06:00
package.scala Scaladoc documentation for some core Spark functionality 2012-10-04 22:59:36 -07:00
PairRDDFunctions.scala Reduced the memory usage of reduce and similar operations 2013-02-01 15:38:42 -08:00
ParallelCollection.scala Further simplify getOrElse call. 2013-01-21 21:30:24 -06:00
Partitioner.scala Raise exception when hashing Java arrays (SPARK-597) 2012-12-31 20:20:11 -08:00
RDD.scala Reduced the memory usage of reduce and similar operations 2013-02-01 15:38:42 -08:00
RDDCheckpointData.scala Simplify checkpointing code and RDD class a little: 2013-01-28 22:30:12 -08:00
SequenceFileRDDFunctions.scala Update Hadoop dependency to 1.0.3 as 0.20 has Sun specific dependencies. Also 2013-01-07 15:57:33 -08:00
SerializableWritable.scala Fix issue #65: Change @serializable to extends Serializable in 2.9 branch 2011-08-02 10:16:33 +01:00
ShuffleFetcher.scala Change ShuffleFetcher to return an Iterator. 2012-10-13 14:59:20 -07:00
SizeEstimator.scala Remove dependencies on sun jvm classes. Instead use reflection to infer 2013-01-07 15:57:18 -08:00
SoftReferenceCache.scala Make classes package private 2012-10-02 19:00:19 -07:00
SparkContext.scala Reduced the memory usage of reduce and similar operations 2013-02-01 15:38:42 -08:00
SparkEnv.scala Merge branch 'master' into driver 2013-01-28 23:30:24 -06:00
SparkException.scala Upgraded to Akka 2 and fixed test execution (which was still parallel 2012-06-28 23:51:28 -07:00
SparkFiles.java Allow PySpark's SparkFiles to be used from driver 2013-01-23 10:58:50 -08:00
Split.scala Various code style fixes, mostly from IntelliJ IDEA 2012-06-29 18:47:12 -07:00
TaskContext.scala Minor cleanup. 2013-01-21 15:55:46 -06:00
TaskEndReason.scala Stylistic changes and Public Accumulable and Broadcast 2012-10-02 19:28:37 -07:00
TaskState.scala Make classes package private 2012-10-02 19:00:19 -07:00
Utils.scala Reduced the memory usage of reduce and similar operations 2013-02-01 15:38:42 -08:00