Matei Zaharia
ccfe953a4d
Merge pull request #577 from skumargithub/master
...
Example of cumulative counting using updateStateByKey
2013-06-29 17:57:53 -07:00
Reynold Xin
79b5eaa4e2
Added a 64bit string hash function.
2013-06-29 15:58:59 -07:00
Reynold Xin
758ceff778
Updated BytecodeUtils to ASM4.
2013-06-29 15:39:48 -07:00
Matei Zaharia
5cfcd3c336
Remove Twitter4J specific repo since it's in Maven central
2013-06-29 15:37:27 -07:00
Reynold Xin
564d902d79
Merge branch 'master' of github.com:mesos/spark into graph
...
Conflicts:
run
run2.cmd
2013-06-29 15:30:21 -07:00
Matei Zaharia
4358acfe07
Initialize Twitter4J OAuth from system properties instead of prompting
2013-06-29 15:25:06 -07:00
Reynold Xin
ae0eca5ec8
Merge branch 'graph' of github.com:rxin/spark into graph
2013-06-29 15:22:33 -07:00
Reynold Xin
ae12d163dc
Added the BytecodeUtils class for analyzing bytecode.
2013-06-29 15:22:15 -07:00
Matei Zaharia
1667158544
Merge remote-tracking branch 'mrpotes/master'
2013-06-29 14:36:09 -07:00
Patrick Wendell
e721ff7e5a
Allowing details for failed stages
2013-06-29 11:26:30 -07:00
Patrick Wendell
473961d82e
Styling for progress bar
2013-06-29 08:38:04 -07:00
Joseph E. Gonzalez
a80b28a579
Renamed several functions and classes and improved documentation
2013-06-28 18:18:51 -07:00
Evan Chan
1107b4d55b
Merge branch 'master' into 2013-06/assembly-jar-deploy
...
Conflicts:
run
Previous changes that I made to run and set-dev-classpath.sh instead
have been folded into compute-classpath.sh
2013-06-28 17:18:35 -07:00
Evan Chan
8113c55df8
[Feedback] Get rid of -m, set MASTER from SPARK_MASTER_IP/PORT automagically
2013-06-28 13:46:21 -07:00
Patrick Wendell
249f0e54ba
Minor changes from Matei's review
2013-06-28 13:25:26 -07:00
Matei Zaharia
50ca17635a
Merge pull request #664 from pwendell/test-fix
...
Removing incorrect test statement
2013-06-27 22:24:52 -07:00
Matei Zaharia
4974b658ed
Look at JAVA_HOME before PATH to determine Java executable
2013-06-27 22:16:40 -07:00
Patrick Wendell
c537e869f3
Missing logo file
2013-06-27 22:02:03 -07:00
Patrick Wendell
c767e74370
Removing incorrect test statement
2013-06-27 21:48:58 -07:00
Patrick Wendell
62c2c6b856
Forcing Jetty to run as daemon
2013-06-27 21:47:22 -07:00
Patrick Wendell
a55190d314
Adding better tabs for UI headers.
2013-06-27 19:14:51 -07:00
Patrick Wendell
362d996c81
Handful of changes based on matei's review
...
- Avoid exception when no tasks have finished for a stage
- Adding DOCTYPE so css renders properly
- Adding progress slider
2013-06-27 19:14:28 -07:00
Patrick Wendell
92a4c2a5f6
Fixing bug in local scheduler time recording
2013-06-27 12:33:06 -07:00
Matei Zaharia
aea727f68d
Simplify Python docs a little to do substring search
2013-06-26 21:15:09 -07:00
Matei Zaharia
03906f7f0a
Fixes to compute-classpath on Windows
2013-06-26 17:40:22 -07:00
Patrick Wendell
13e3dd98d8
Removing mesos support
2013-06-26 11:36:39 -07:00
Matei Zaharia
e49bc8ca8c
Merge pull request #663 from stephenh/option_and_getenv
...
Be cute with Option and getenv.
2013-06-26 11:13:33 -07:00
Stephen Haberman
d7011632d1
Wrap lines.
2013-06-26 12:35:57 -05:00
Patrick Wendell
ee692482a6
One more private class
2013-06-26 09:07:32 -07:00
Patrick Wendell
a59c15a37e
Adding config option for retained stages
2013-06-26 08:54:57 -07:00
Patrick Wendell
274193664a
Bumping timeouts
2013-06-26 08:51:28 -07:00
Patrick Wendell
b14ad509ba
Moving static ui package
2013-06-26 08:46:51 -07:00
Patrick Wendell
2cbaa0734b
Making all new classes package private
2013-06-26 08:44:55 -07:00
Stephen Haberman
d11025dc6a
Be cute with Option and getenv.
2013-06-26 09:53:35 -05:00
Matei Zaharia
32370da4e4
Don't use forward slash in exclusion for JAR signature files
2013-06-25 22:08:19 -04:00
Matei Zaharia
9f0d913295
Refactored tests to share SparkContexts in some of them
...
Creating these seems to take a while and clutters the output with Akka
stuff, so it would be nice to share them.
2013-06-25 19:18:30 -04:00
Matei Zaharia
2bd04c3513
Formatting
2013-06-25 18:37:14 -04:00
Matei Zaharia
f2263350ed
Added a local-cluster mode test to ReplSuite
2013-06-25 18:35:35 -04:00
Matei Zaharia
6c8d1b2ca6
Fix computation of classpath when we launch java directly
...
The previous version assumed that a CLASSPATH environment variable was
set by the "run" script when launching the process that starts the
ExecutorRunner, but unfortunately this is not true in tests. Instead, we
factor the classpath calculation into an extenral script and call that.
NOTE: This includes a Windows version but hasn't yet been tested there.
2013-06-25 18:21:00 -04:00
James Phillpotts
176193b1e8
Fix usage and parameter extraction
2013-06-25 23:06:15 +01:00
Evan Chan
8dd78f80b5
Manually merge spark/master commit d92d3f7938
2013-06-25 15:01:06 -07:00
James Phillpotts
366572edca
Include a default OAuth implementation, and update examples and JavaStreamingContext
2013-06-25 22:59:34 +01:00
Evan Chan
d2f46ac680
Merge branch 'master' into 2013-06/assembly-jar-deploy
...
Conflicts:
run
2013-06-25 14:50:16 -07:00
Matei Zaharia
15b00914c5
Some fixes to the launch-java-directly change:
...
- Split SPARK_JAVA_OPTS into multiple command-line arguments if it
contains spaces; this splitting follows quoting rules in bash
- Add the Scala JARs to the classpath if they're not in the CLASSPATH
variable because the ExecutorRunner is launched with "scala" (this can
happen when using local-cluster URLs in spark-shell)
2013-06-25 17:17:27 -04:00
Matei Zaharia
7680ce0bd6
Fixed deprecated use of expect in SizeEstimatorSuite
2013-06-25 16:11:44 -04:00
Matei Zaharia
7e0191c6ea
Merge remote-tracking branch 'cgrothaus/SPARK-698'
...
Conflicts:
run
2013-06-25 15:47:40 -04:00
Evan Chan
982a686ff8
Add -m and -c <cores> options to spark-shell for convenience
2013-06-25 11:14:21 -07:00
Matei Zaharia
f5e32ed13a
Merge pull request #661 from mesos/streaming
...
Kafka fixes and DStream.count fix for master
2013-06-25 09:16:57 -07:00
Evan Chan
243d71cb06
Add deploy/testing procedure
2013-06-25 00:15:58 -07:00
Evan Chan
c3d11d0d57
Get rid of debugging statements
2013-06-25 00:02:00 -07:00
