Tathagata Das
|
f90f794cde
|
Minor name fix
|
2013-01-13 21:25:57 -08:00 |
|
Tathagata Das
|
6cc8592f26
|
Fixed bug
|
2013-01-13 21:20:49 -08:00 |
|
Tathagata Das
|
0dbd411a56
|
Added documentation for PairDStreamFunctions.
|
2013-01-13 21:08:35 -08:00 |
|
Matei Zaharia
|
cb867e9ffb
|
Merge branch 'master' of github.com:mesos/spark
|
2013-01-13 19:34:32 -08:00 |
|
Matei Zaharia
|
72408e8dfa
|
Make filter preserve partitioner info, since it can
|
2013-01-13 19:34:07 -08:00 |
|
Tathagata Das
|
0a2e333341
|
Removed stream id from the constructor of NetworkReceiver to make it easier for PluggableNetworkInputDStream.
|
2013-01-13 16:18:39 -08:00 |
|
Matei Zaharia
|
9a34409810
|
Merge pull request #360 from rxin/cogroup-java
Changed CoGroupRDD's hash map from Scala to Java.
|
2013-01-13 15:31:08 -08:00 |
|
Reynold Xin
|
be7166146b
|
Removed the use of getOrElse to avoid Scala wrapper for every call.
|
2013-01-13 15:27:28 -08:00 |
|
Tathagata Das
|
23b54f62b7
|
Merge pull request #366 from tdas/streaming
Code refactoring
|
2013-01-13 14:07:34 -08:00 |
|
Matei Zaharia
|
530493b0e8
|
Merge pull request #365 from ryanlecompte/rate_limiter_timing_cleanup
Improve sleeping algorithm for rate limiting output streams
|
2013-01-13 10:47:00 -08:00 |
|
Ryan LeCompte
|
c31931af7e
|
switch to uppercase constants
|
2013-01-13 10:39:47 -08:00 |
|
Ryan LeCompte
|
2305a2c1d9
|
more code cleanup
|
2013-01-13 10:01:56 -08:00 |
|
Matei Zaharia
|
62e4767394
|
Merge pull request #368 from mbautin/add_spray_json_dependency
Add missing dependency spray-json to Maven build
|
2013-01-13 00:48:21 -08:00 |
|
Mikhail Bautin
|
88d8f11365
|
Add missing dependency spray-json to Maven build
|
2013-01-13 00:46:25 -08:00 |
|
Matei Zaharia
|
fbb3fc4143
|
Merge pull request #346 from JoshRosen/python-api
Python API (PySpark)
|
2013-01-12 23:49:36 -08:00 |
|
Matei Zaharia
|
44b3e41f2e
|
Merge pull request #367 from ericzhang-cn/master
fix spelling mistake in LocalLR example
|
2013-01-12 23:37:17 -08:00 |
|
Eric Zhang
|
ba06e9c97c
|
Update examples/src/main/scala/spark/examples/LocalLR.scala
fix spelling mistake
|
2013-01-13 15:33:11 +08:00 |
|
Matei Zaharia
|
01413ca0e7
|
Merge pull request #364 from tysonjh/master
Executor and JobDescription JSON support added
|
2013-01-12 16:17:07 -08:00 |
|
Matei Zaharia
|
3ef82496f4
|
Merge pull request #363 from heuermh/quick-start-fix
add repositories section to quick-start SimpleJob pom.xml
|
2013-01-12 16:15:10 -08:00 |
|
Matei Zaharia
|
995075bf79
|
Merge pull request #355 from shivaram/default-hadoop-pom
Activate hadoop1 profile by default for maven builds
|
2013-01-12 15:38:36 -08:00 |
|
Shivaram Venkataraman
|
bbc56d85ed
|
Rename environment variable for hadoop profiles to hadoopVersion
|
2013-01-12 15:24:13 -08:00 |
|
Ryan LeCompte
|
addff2c466
|
add comment
|
2013-01-12 09:57:29 -08:00 |
|
Ryan LeCompte
|
ea20ae6618
|
add one extra test
|
2013-01-12 09:18:00 -08:00 |
|
Ryan LeCompte
|
2c77eeebb6
|
correct test params
|
2013-01-12 00:13:45 -08:00 |
|
Ryan LeCompte
|
0cfea7a2ec
|
add unit test
|
2013-01-11 23:48:07 -08:00 |
|
Ryan LeCompte
|
ff10b3aa09
|
add missing return
|
2013-01-11 21:03:57 -08:00 |
|
Ryan LeCompte
|
22445fbea9
|
attempt to sleep for more accurate time period, minor cleanup
|
2013-01-11 13:30:49 -08:00 |
|
Tyson
|
1731f1fed4
|
Added an optional format parameter for individual job queries and optimized the jobId query
|
2013-01-11 15:01:43 -05:00 |
|
Tyson
|
c063e8777e
|
Added implicit json writers for JobDescription and ExecutorRunner
|
2013-01-11 14:57:38 -05:00 |
|
Michael Heuer
|
480c4139bb
|
add repositories section to simple job pom.xml
|
2013-01-11 11:40:17 -06:00 |
|
Stephen Haberman
|
5c7a127219
|
Pass a new Configuration that wraps the default hadoopConfiguration.
|
2013-01-11 11:25:11 -06:00 |
|
Stephen Haberman
|
3e6519a36e
|
Use hadoopConfiguration for default JobConf in PairRDDFunctions.
|
2013-01-11 11:24:20 -06:00 |
|
Shivaram Venkataraman
|
9262522306
|
Activate hadoop2 profile in pom.xml with -Dhadoop=2
|
2013-01-10 22:07:34 -08:00 |
|
Matei Zaharia
|
2e914d9983
|
Formatting
|
2013-01-10 19:13:08 -08:00 |
|
Matei Zaharia
|
3548c9c0c8
|
Merge branch 'master' of github.com:mesos/spark
|
2013-01-10 19:06:40 -08:00 |
|
Matei Zaharia
|
6d1c230281
|
Merge pull request #357 from tysonjh/master
JSON support added to WebUI
|
2013-01-10 19:06:07 -08:00 |
|
Matei Zaharia
|
aa1c8c602d
|
Merge pull request #358 from stephenh/shorterclasspath
Retrieve jars to a flat directory so * can be used for the classpath.
|
2013-01-10 18:04:47 -08:00 |
|
Matei Zaharia
|
248995c535
|
Merge pull request #356 from shane-huang/master
Fix an issue in ConnectionManager where sendMessage may create too many unnecessary connections
|
2013-01-10 17:52:23 -08:00 |
|
Reynold Xin
|
bd336f5f40
|
Changed CoGroupRDD's hash map from Scala to Java.
|
2013-01-10 17:13:04 -08:00 |
|
Stephen Haberman
|
d1864052c5
|
Fix invalid asInstanceOf cast.
|
2013-01-10 12:16:26 -06:00 |
|
Stephen Haberman
|
b15e851279
|
Check for AWS_ACCESS_KEY_ID/AWS_SECRET_ACCESS_KEY environment variables.
For custom properties, use "spark.hadoop.*" as a prefix instead of just "hadoop.*".
|
2013-01-10 10:55:41 -06:00 |
|
Josh Rosen
|
49c74ba2af
|
Change PYSPARK_PYTHON_EXEC to PYSPARK_PYTHON.
|
2013-01-10 08:10:59 -08:00 |
|
shane-huang
|
9930a95d21
|
Modified Patch according to comments
|
2013-01-10 20:09:55 +08:00 |
|
Josh Rosen
|
d55f2b9882
|
Use take() instead of takeSample() in PySpark kmeans example.
This is a temporary change until we port takeSample().
|
2013-01-09 21:21:23 -08:00 |
|
Josh Rosen
|
1a64432ba5
|
Indicate success/failure in PySpark test script.
|
2013-01-09 20:30:36 -08:00 |
|
Stephen Haberman
|
e3861ae395
|
Provide and expose a default Hadoop Configuration.
Any "hadoop.*" system properties will be passed along into configuration.
|
2013-01-09 17:08:14 -06:00 |
|
Tathagata Das
|
365506fb03
|
Changed variable name form ***Time to ***Duration to keep things consistent.
|
2013-01-09 14:29:25 -08:00 |
|
Tathagata Das
|
156e8b47ef
|
Split Time to Time (absolute instant of time) and Duration (duration of time).
|
2013-01-09 12:42:10 -08:00 |
|
Tyson
|
549ee388a1
|
Removed io.spray spray-json dependency as it is not needed.
|
2013-01-09 15:12:23 -05:00 |
|
Tyson
|
bf9d9946f9
|
Query parameter reformatted to be more extensible and routing more robust
|
2013-01-09 11:29:58 -05:00 |
|