Commit graph

1619 commits

Author SHA1 Message Date
Prashant Sharma 19b0256ae4 Added standalone cluster repl suite 2013-04-15 19:49:40 +05:30
Prashant Sharma f31e41c270 Added class wrappers instead of object and incorporated most of matei comments 2013-04-10 15:08:01 +05:30
Prashant Sharma b67c638b85 Made shell loading synchronous as async loading confuses with out of order status messages 2013-04-10 14:48:49 +05:30
Prashant Sharma 9f26318bbd Fixed previously removed dependencies 2013-04-10 14:46:42 +05:30
Prashant Sharma 5a080acdb8 Fixed broken tests by last commit for repl. 2013-03-25 10:43:45 +05:30
Prashant Sharma d9f34e505d Ctrl-D hang bug fixed! 2013-03-20 00:18:04 +05:30
prashant 432a227320 fixed autocompletion apparent hang due to logging 2013-03-19 12:29:08 +05:30
Prashant Sharma 15530c2b23 porting of repl to scala-2.10 2013-03-17 10:47:17 +05:30
Matei Zaharia 73b3feebb9 Merge pull request #388 from folone/master
Updated maven build configuration for Scala 2.10
2013-01-20 10:11:49 -08:00
folone fd6e51deec Fixed the failing test. 2013-01-20 17:02:58 +01:00
folone ad8aff6ca4 Merge remote-tracking branch 'upstream/master' 2013-01-20 14:43:20 +01:00
folone a5403acd4e Updated maven build for scala 2.10. 2013-01-20 14:42:16 +01:00
Matei Zaharia 54c0f9f185 Fix code that assumed spark.local.dir is only a single directory 2013-01-17 17:40:55 -08:00
Matei Zaharia b534fd363f Merge pull request #382 from fanuo/master
HttpBroadcast server cache by default in spark.local.dir instead of java.io.tmpdir
2013-01-17 17:00:25 -08:00
Fernand Pajot 742bc841ad changed HttpBroadcast server cache to be in spark.local.dir instead of java.io.tmpdir 2013-01-17 16:56:11 -08:00
Matei Zaharia 46644e409d Merge branch 'master' of github.com:mesos/spark 2013-01-17 11:17:19 -08:00
Matei Zaharia 892c32a14b Warn users if they run pyspark or spark-shell without compiling Spark 2013-01-17 11:14:47 -08:00
Matei Zaharia aff1844155 Merge pull request #381 from squito/remove_threadpool
remove unused thread pool
2013-01-16 16:46:42 -08:00
Imran Rashid eae698f755 remove unused thread pool 2013-01-16 12:21:37 -08:00
Matei Zaharia 4beb084f64 Merge pull request #374 from woggling/null-mapout
Generate FetchFailedException even for cached missing map outputs
2013-01-15 14:22:29 -08:00
Matei Zaharia 7adfedb0d7 Merge pull request #378 from apsaltis/master
Updated SCALA_VERSION in run2.cmd to match runtime version of Scala
2013-01-15 14:20:44 -08:00
Charles Reiss 4078623b9f Remove broken attempt to test fetching case. 2013-01-15 12:05:54 -08:00
Andrew Psaltis c7143e5507 Changed teh scala version to 2.9.2, so that the classes can be found when the classpath is expanded. 2013-01-15 12:45:42 -07:00
Matei Zaharia 20adf27480 Merge pull request #371 from folone/master
Scala 2.10.0
2013-01-15 11:03:49 -08:00
Matei Zaharia 3a98611d6b Merge pull request #377 from stephenh/executeOnCompleteCallbackInFinally
Call executeOnCompleteCallbacks in a finally block.
2013-01-15 10:38:04 -08:00
Stephen Haberman d228bff440 Add a test. 2013-01-15 11:48:50 -06:00
Stephen Haberman dd583b7ebf Call executeOnCompleteCallbacks in a finally block. 2013-01-15 10:52:06 -06:00
Charles Reiss b038999797 Fix accidental spark.master.host reuse 2013-01-14 17:04:44 -08:00
Charles Reiss 7ba34bc007 Additional tests for MapOutputTracker. 2013-01-14 15:27:02 -08:00
Charles Reiss 273fb5cc10 Throw FetchFailedException for cached missing locs 2013-01-14 15:26:48 -08:00
folone 25c0739bad Moved to scala 2.10.0. Notable changes are:
- akka  2.0.3  → 2.1.0
- spray 1.0-M1 → 1.1-M7
For now the repl subproject is commented out, as scala reflection api changed very much since the introduction of macros.
2013-01-14 09:52:11 +01:00
Matei Zaharia cb867e9ffb Merge branch 'master' of github.com:mesos/spark 2013-01-13 19:34:32 -08:00
Matei Zaharia 72408e8dfa Make filter preserve partitioner info, since it can 2013-01-13 19:34:07 -08:00
Matei Zaharia 9a34409810 Merge pull request #360 from rxin/cogroup-java
Changed CoGroupRDD's hash map from Scala to Java.
2013-01-13 15:31:08 -08:00
Reynold Xin be7166146b Removed the use of getOrElse to avoid Scala wrapper for every call. 2013-01-13 15:27:28 -08:00
Matei Zaharia 62e4767394 Merge pull request #368 from mbautin/add_spray_json_dependency
Add missing dependency spray-json to Maven build
2013-01-13 00:48:21 -08:00
Mikhail Bautin 88d8f11365 Add missing dependency spray-json to Maven build 2013-01-13 00:46:25 -08:00
Matei Zaharia fbb3fc4143 Merge pull request #346 from JoshRosen/python-api
Python API (PySpark)
2013-01-12 23:49:36 -08:00
Matei Zaharia 44b3e41f2e Merge pull request #367 from ericzhang-cn/master
fix spelling mistake in LocalLR example
2013-01-12 23:37:17 -08:00
Eric Zhang ba06e9c97c Update examples/src/main/scala/spark/examples/LocalLR.scala
fix spelling mistake
2013-01-13 15:33:11 +08:00
Matei Zaharia 01413ca0e7 Merge pull request #364 from tysonjh/master
Executor and JobDescription JSON support added
2013-01-12 16:17:07 -08:00
Matei Zaharia 3ef82496f4 Merge pull request #363 from heuermh/quick-start-fix
add repositories section to quick-start SimpleJob pom.xml
2013-01-12 16:15:10 -08:00
Matei Zaharia 995075bf79 Merge pull request #355 from shivaram/default-hadoop-pom
Activate hadoop1 profile by default for maven builds
2013-01-12 15:38:36 -08:00
Shivaram Venkataraman bbc56d85ed Rename environment variable for hadoop profiles to hadoopVersion 2013-01-12 15:24:13 -08:00
Tyson 1731f1fed4 Added an optional format parameter for individual job queries and optimized the jobId query 2013-01-11 15:01:43 -05:00
Tyson c063e8777e Added implicit json writers for JobDescription and ExecutorRunner 2013-01-11 14:57:38 -05:00
Michael Heuer 480c4139bb add repositories section to simple job pom.xml 2013-01-11 11:40:17 -06:00
Shivaram Venkataraman 9262522306 Activate hadoop2 profile in pom.xml with -Dhadoop=2 2013-01-10 22:07:34 -08:00
Matei Zaharia 2e914d9983 Formatting 2013-01-10 19:13:08 -08:00
Matei Zaharia 3548c9c0c8 Merge branch 'master' of github.com:mesos/spark 2013-01-10 19:06:40 -08:00