Prashant Sharma
bf5fc07379
Added more tests
2013-04-19 13:51:16 +05:30
Prashant Sharma
36ccb35371
Changed spark context as lazy val to become just val.
2013-04-16 11:13:51 +05:30
Prashant Sharma
19b0256ae4
Added standalone cluster repl suite
2013-04-15 19:49:40 +05:30
Prashant Sharma
f31e41c270
Added class wrappers instead of object and incorporated most of matei comments
2013-04-10 15:08:01 +05:30
Prashant Sharma
b67c638b85
Made shell loading synchronous as async loading confuses with out of order status messages
2013-04-10 14:48:49 +05:30
Prashant Sharma
9f26318bbd
Fixed previously removed dependencies
2013-04-10 14:46:42 +05:30
Prashant Sharma
5a080acdb8
Fixed broken tests by last commit for repl.
2013-03-25 10:43:45 +05:30
Prashant Sharma
d9f34e505d
Ctrl-D hang bug fixed!
2013-03-20 00:18:04 +05:30
prashant
432a227320
fixed autocompletion apparent hang due to logging
2013-03-19 12:29:08 +05:30
Prashant Sharma
15530c2b23
porting of repl to scala-2.10
2013-03-17 10:47:17 +05:30
Matei Zaharia
73b3feebb9
Merge pull request #388 from folone/master
...
Updated maven build configuration for Scala 2.10
2013-01-20 10:11:49 -08:00
folone
fd6e51deec
Fixed the failing test.
2013-01-20 17:02:58 +01:00
folone
ad8aff6ca4
Merge remote-tracking branch 'upstream/master'
2013-01-20 14:43:20 +01:00
folone
a5403acd4e
Updated maven build for scala 2.10.
2013-01-20 14:42:16 +01:00
Matei Zaharia
54c0f9f185
Fix code that assumed spark.local.dir is only a single directory
2013-01-17 17:40:55 -08:00
Matei Zaharia
b534fd363f
Merge pull request #382 from fanuo/master
...
HttpBroadcast server cache by default in spark.local.dir instead of java.io.tmpdir
2013-01-17 17:00:25 -08:00
Fernand Pajot
742bc841ad
changed HttpBroadcast server cache to be in spark.local.dir instead of java.io.tmpdir
2013-01-17 16:56:11 -08:00
Matei Zaharia
46644e409d
Merge branch 'master' of github.com:mesos/spark
2013-01-17 11:17:19 -08:00
Matei Zaharia
892c32a14b
Warn users if they run pyspark or spark-shell without compiling Spark
2013-01-17 11:14:47 -08:00
Matei Zaharia
aff1844155
Merge pull request #381 from squito/remove_threadpool
...
remove unused thread pool
2013-01-16 16:46:42 -08:00
Imran Rashid
eae698f755
remove unused thread pool
2013-01-16 12:21:37 -08:00
Matei Zaharia
4beb084f64
Merge pull request #374 from woggling/null-mapout
...
Generate FetchFailedException even for cached missing map outputs
2013-01-15 14:22:29 -08:00
Matei Zaharia
7adfedb0d7
Merge pull request #378 from apsaltis/master
...
Updated SCALA_VERSION in run2.cmd to match runtime version of Scala
2013-01-15 14:20:44 -08:00
Charles Reiss
4078623b9f
Remove broken attempt to test fetching case.
2013-01-15 12:05:54 -08:00
Andrew Psaltis
c7143e5507
Changed teh scala version to 2.9.2, so that the classes can be found when the classpath is expanded.
2013-01-15 12:45:42 -07:00
Matei Zaharia
20adf27480
Merge pull request #371 from folone/master
...
Scala 2.10.0
2013-01-15 11:03:49 -08:00
Matei Zaharia
3a98611d6b
Merge pull request #377 from stephenh/executeOnCompleteCallbackInFinally
...
Call executeOnCompleteCallbacks in a finally block.
2013-01-15 10:38:04 -08:00
Stephen Haberman
d228bff440
Add a test.
2013-01-15 11:48:50 -06:00
Stephen Haberman
dd583b7ebf
Call executeOnCompleteCallbacks in a finally block.
2013-01-15 10:52:06 -06:00
Charles Reiss
b038999797
Fix accidental spark.master.host reuse
2013-01-14 17:04:44 -08:00
Charles Reiss
7ba34bc007
Additional tests for MapOutputTracker.
2013-01-14 15:27:02 -08:00
Charles Reiss
273fb5cc10
Throw FetchFailedException for cached missing locs
2013-01-14 15:26:48 -08:00
folone
25c0739bad
Moved to scala 2.10.0. Notable changes are:
...
- akka 2.0.3 → 2.1.0
- spray 1.0-M1 → 1.1-M7
For now the repl subproject is commented out, as scala reflection api changed very much since the introduction of macros.
2013-01-14 09:52:11 +01:00
Matei Zaharia
cb867e9ffb
Merge branch 'master' of github.com:mesos/spark
2013-01-13 19:34:32 -08:00
Matei Zaharia
72408e8dfa
Make filter preserve partitioner info, since it can
2013-01-13 19:34:07 -08:00
Matei Zaharia
9a34409810
Merge pull request #360 from rxin/cogroup-java
...
Changed CoGroupRDD's hash map from Scala to Java.
2013-01-13 15:31:08 -08:00
Reynold Xin
be7166146b
Removed the use of getOrElse to avoid Scala wrapper for every call.
2013-01-13 15:27:28 -08:00
Matei Zaharia
62e4767394
Merge pull request #368 from mbautin/add_spray_json_dependency
...
Add missing dependency spray-json to Maven build
2013-01-13 00:48:21 -08:00
Mikhail Bautin
88d8f11365
Add missing dependency spray-json to Maven build
2013-01-13 00:46:25 -08:00
Matei Zaharia
fbb3fc4143
Merge pull request #346 from JoshRosen/python-api
...
Python API (PySpark)
2013-01-12 23:49:36 -08:00
Matei Zaharia
44b3e41f2e
Merge pull request #367 from ericzhang-cn/master
...
fix spelling mistake in LocalLR example
2013-01-12 23:37:17 -08:00
Eric Zhang
ba06e9c97c
Update examples/src/main/scala/spark/examples/LocalLR.scala
...
fix spelling mistake
2013-01-13 15:33:11 +08:00
Matei Zaharia
01413ca0e7
Merge pull request #364 from tysonjh/master
...
Executor and JobDescription JSON support added
2013-01-12 16:17:07 -08:00
Matei Zaharia
3ef82496f4
Merge pull request #363 from heuermh/quick-start-fix
...
add repositories section to quick-start SimpleJob pom.xml
2013-01-12 16:15:10 -08:00
Matei Zaharia
995075bf79
Merge pull request #355 from shivaram/default-hadoop-pom
...
Activate hadoop1 profile by default for maven builds
2013-01-12 15:38:36 -08:00
Shivaram Venkataraman
bbc56d85ed
Rename environment variable for hadoop profiles to hadoopVersion
2013-01-12 15:24:13 -08:00
Tyson
1731f1fed4
Added an optional format parameter for individual job queries and optimized the jobId query
2013-01-11 15:01:43 -05:00
Tyson
c063e8777e
Added implicit json writers for JobDescription and ExecutorRunner
2013-01-11 14:57:38 -05:00
Michael Heuer
480c4139bb
add repositories section to simple job pom.xml
2013-01-11 11:40:17 -06:00
Shivaram Venkataraman
9262522306
Activate hadoop2 profile in pom.xml with -Dhadoop=2
2013-01-10 22:07:34 -08:00