ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
1604 commits 6 branches 181 tags 397 MiB
Commit graph

1604 commits

This branch
This branch
All branches
Author SHA1 Message Date
Matei Zaharia b534fd363f Merge pull request #382 from fanuo/master 
HttpBroadcast server cache by default in spark.local.dir instead of java.io.tmpdir
 2013-01-17 17:00:25 -08:00
Fernand Pajot 742bc841ad changed HttpBroadcast server cache to be in spark.local.dir instead of java.io.tmpdir 2013-01-17 16:56:11 -08:00
Matei Zaharia 46644e409d Merge branch 'master' of github.com:mesos/spark 2013-01-17 11:17:19 -08:00
Matei Zaharia 892c32a14b Warn users if they run pyspark or spark-shell without compiling Spark 2013-01-17 11:14:47 -08:00
Matei Zaharia aff1844155 Merge pull request #381 from squito/remove_threadpool 
remove unused thread pool
 2013-01-16 16:46:42 -08:00
Imran Rashid eae698f755 remove unused thread pool 2013-01-16 12:21:37 -08:00
Matei Zaharia 4beb084f64 Merge pull request #374 from woggling/null-mapout 
Generate FetchFailedException even for cached missing map outputs
 2013-01-15 14:22:29 -08:00
Matei Zaharia 7adfedb0d7 Merge pull request #378 from apsaltis/master 
Updated SCALA_VERSION in run2.cmd to match runtime version of Scala
 2013-01-15 14:20:44 -08:00
Charles Reiss 4078623b9f Remove broken attempt to test fetching case. 2013-01-15 12:05:54 -08:00
Andrew Psaltis c7143e5507 Changed teh scala version to 2.9.2, so that the classes can be found when the classpath is expanded. 2013-01-15 12:45:42 -07:00
Matei Zaharia 3a98611d6b Merge pull request #377 from stephenh/executeOnCompleteCallbackInFinally 
Call executeOnCompleteCallbacks in a finally block.
 2013-01-15 10:38:04 -08:00
Stephen Haberman d228bff440 Add a test. 2013-01-15 11:48:50 -06:00
Stephen Haberman dd583b7ebf Call executeOnCompleteCallbacks in a finally block. 2013-01-15 10:52:06 -06:00
Charles Reiss b038999797 Fix accidental spark.master.host reuse 2013-01-14 17:04:44 -08:00
Charles Reiss 7ba34bc007 Additional tests for MapOutputTracker. 2013-01-14 15:27:02 -08:00
Charles Reiss 273fb5cc10 Throw FetchFailedException for cached missing locs 2013-01-14 15:26:48 -08:00
Matei Zaharia cb867e9ffb Merge branch 'master' of github.com:mesos/spark 2013-01-13 19:34:32 -08:00
Matei Zaharia 72408e8dfa Make filter preserve partitioner info, since it can 2013-01-13 19:34:07 -08:00
Matei Zaharia 9a34409810 Merge pull request #360 from rxin/cogroup-java 
Changed CoGroupRDD's hash map from Scala to Java.
 2013-01-13 15:31:08 -08:00
Reynold Xin be7166146b Removed the use of getOrElse to avoid Scala wrapper for every call. 2013-01-13 15:27:28 -08:00
Matei Zaharia 62e4767394 Merge pull request #368 from mbautin/add_spray_json_dependency 
Add missing dependency spray-json to Maven build
 2013-01-13 00:48:21 -08:00
Mikhail Bautin 88d8f11365 Add missing dependency spray-json to Maven build 2013-01-13 00:46:25 -08:00
Matei Zaharia fbb3fc4143 Merge pull request #346 from JoshRosen/python-api 
Python API (PySpark)
 2013-01-12 23:49:36 -08:00
Matei Zaharia 44b3e41f2e Merge pull request #367 from ericzhang-cn/master 
fix spelling mistake in LocalLR example
 2013-01-12 23:37:17 -08:00
Eric Zhang ba06e9c97c Update examples/src/main/scala/spark/examples/LocalLR.scala 
fix spelling mistake
 2013-01-13 15:33:11 +08:00
Matei Zaharia 01413ca0e7 Merge pull request #364 from tysonjh/master 
Executor and JobDescription JSON support added
 2013-01-12 16:17:07 -08:00
Matei Zaharia 3ef82496f4 Merge pull request #363 from heuermh/quick-start-fix 
add repositories section to quick-start SimpleJob pom.xml
 2013-01-12 16:15:10 -08:00
Matei Zaharia 995075bf79 Merge pull request #355 from shivaram/default-hadoop-pom 
Activate hadoop1 profile by default for maven builds
 2013-01-12 15:38:36 -08:00
Shivaram Venkataraman bbc56d85ed Rename environment variable for hadoop profiles to hadoopVersion 2013-01-12 15:24:13 -08:00
Tyson 1731f1fed4 Added an optional format parameter for individual job queries and optimized the jobId query 2013-01-11 15:01:43 -05:00
Tyson c063e8777e Added implicit json writers for JobDescription and ExecutorRunner 2013-01-11 14:57:38 -05:00
Michael Heuer 480c4139bb add repositories section to simple job pom.xml 2013-01-11 11:40:17 -06:00
Shivaram Venkataraman 9262522306 Activate hadoop2 profile in pom.xml with -Dhadoop=2 2013-01-10 22:07:34 -08:00
Matei Zaharia 2e914d9983 Formatting 2013-01-10 19:13:08 -08:00
Matei Zaharia 3548c9c0c8 Merge branch 'master' of github.com:mesos/spark 2013-01-10 19:06:40 -08:00
Matei Zaharia 6d1c230281 Merge pull request #357 from tysonjh/master 
JSON support added to WebUI
 2013-01-10 19:06:07 -08:00
Matei Zaharia aa1c8c602d Merge pull request #358 from stephenh/shorterclasspath 
Retrieve jars to a flat directory so * can be used for the classpath.
 2013-01-10 18:04:47 -08:00
Matei Zaharia 248995c535 Merge pull request #356 from shane-huang/master 
Fix an issue in ConnectionManager where sendMessage may create too many unnecessary connections
 2013-01-10 17:52:23 -08:00
Reynold Xin bd336f5f40 Changed CoGroupRDD's hash map from Scala to Java. 2013-01-10 17:13:04 -08:00
Josh Rosen 49c74ba2af Change PYSPARK_PYTHON_EXEC to PYSPARK_PYTHON. 2013-01-10 08:10:59 -08:00
shane-huang 9930a95d21 Modified Patch according to comments 2013-01-10 20:09:55 +08:00
Josh Rosen d55f2b9882 Use take() instead of takeSample() in PySpark kmeans example. 
This is a temporary change until we port takeSample().
 2013-01-09 21:21:23 -08:00
Josh Rosen 1a64432ba5 Indicate success/failure in PySpark test script. 2013-01-09 20:30:36 -08:00
Tyson 549ee388a1 Removed io.spray spray-json dependency as it is not needed. 2013-01-09 15:12:23 -05:00
Tyson bf9d9946f9 Query parameter reformatted to be more extensible and routing more robust 2013-01-09 11:29:58 -05:00
Tyson 0da2ff102e Added url query parameter json and handler 2013-01-09 10:40:48 -05:00
Tyson 269fe018c7 JSON object definitions 2013-01-09 10:40:43 -05:00
Tyson 6e8c8f61c4 Added the spray implicit marshaller library 
Added the io.spray JSON library
 2013-01-09 10:40:33 -05:00
Matei Zaharia 9cc764f523 Code style 2013-01-08 22:29:57 -08:00
Matei Zaharia 14972141f9 Merge pull request #344 from mbautin/log_preferred_hosts 
Log preferred hosts
 2013-01-08 22:26:34 -08:00