Reynold Xin
0791581346
More bug fixes
2013-06-30 23:07:40 -07:00
Matei Zaharia
39ae073b5c
Increase SLF4j version in Maven too
2013-06-30 17:11:14 -07:00
Matei Zaharia
5bbd0eec84
Update docs on SCALA_LIBRARY_PATH
2013-06-30 17:00:40 -07:00
Matei Zaharia
03d0b858c8
Made use of spark.executor.memory setting consistent and documented it
...
Conflicts:
core/src/main/scala/spark/SparkContext.scala
2013-06-30 15:46:46 -07:00
Joseph E. Gonzalez
c90967a6a2
Merge branch 'graph' of https://github.com/rxin/spark into graph
2013-06-29 21:53:44 -07:00
Joseph E. Gonzalez
f776301241
Resurrecting the GraphLab gather-apply-scatter api
2013-06-29 21:53:38 -07:00
Joseph E. Gonzalez
f269e5975b
Adding additional assertions and documenting the edge triplet class
2013-06-29 21:53:13 -07:00
Reynold Xin
438a213695
Merge branch 'graph' of github.com:rxin/spark into graph
...
Conflicts:
graph/src/test/scala/spark/graph/GraphSuite.scala
2013-06-29 21:29:17 -07:00
Reynold Xin
6acc2a7b3d
Various minor changes.
2013-06-29 21:28:31 -07:00
Reynold Xin
ce7e270bb4
Added graph package to the classpath.
2013-06-29 21:28:22 -07:00
Joseph E. Gonzalez
f24548da88
Adding graph cosntruction code to graph singleton object.
2013-06-29 21:04:53 -07:00
Joseph E. Gonzalez
2964df7a4e
Commenting out unused test code.
2013-06-29 21:04:35 -07:00
Matei Zaharia
ccfe953a4d
Merge pull request #577 from skumargithub/master
...
Example of cumulative counting using updateStateByKey
2013-06-29 17:57:53 -07:00
Reynold Xin
79b5eaa4e2
Added a 64bit string hash function.
2013-06-29 15:58:59 -07:00
Reynold Xin
758ceff778
Updated BytecodeUtils to ASM4.
2013-06-29 15:39:48 -07:00
Matei Zaharia
5cfcd3c336
Remove Twitter4J specific repo since it's in Maven central
2013-06-29 15:37:27 -07:00
Reynold Xin
564d902d79
Merge branch 'master' of github.com:mesos/spark into graph
...
Conflicts:
run
run2.cmd
2013-06-29 15:30:21 -07:00
Matei Zaharia
4358acfe07
Initialize Twitter4J OAuth from system properties instead of prompting
2013-06-29 15:25:06 -07:00
Reynold Xin
ae0eca5ec8
Merge branch 'graph' of github.com:rxin/spark into graph
2013-06-29 15:22:33 -07:00
Reynold Xin
ae12d163dc
Added the BytecodeUtils class for analyzing bytecode.
2013-06-29 15:22:15 -07:00
Matei Zaharia
1667158544
Merge remote-tracking branch 'mrpotes/master'
2013-06-29 14:36:09 -07:00
Patrick Wendell
e721ff7e5a
Allowing details for failed stages
2013-06-29 11:26:30 -07:00
Patrick Wendell
473961d82e
Styling for progress bar
2013-06-29 08:38:04 -07:00
Joseph E. Gonzalez
a80b28a579
Renamed several functions and classes and improved documentation
2013-06-28 18:18:51 -07:00
Evan Chan
1107b4d55b
Merge branch 'master' into 2013-06/assembly-jar-deploy
...
Conflicts:
run
Previous changes that I made to run and set-dev-classpath.sh instead
have been folded into compute-classpath.sh
2013-06-28 17:18:35 -07:00
Evan Chan
8113c55df8
[Feedback] Get rid of -m, set MASTER from SPARK_MASTER_IP/PORT automagically
2013-06-28 13:46:21 -07:00
Patrick Wendell
249f0e54ba
Minor changes from Matei's review
2013-06-28 13:25:26 -07:00
Matei Zaharia
50ca17635a
Merge pull request #664 from pwendell/test-fix
...
Removing incorrect test statement
2013-06-27 22:24:52 -07:00
Matei Zaharia
4974b658ed
Look at JAVA_HOME before PATH to determine Java executable
2013-06-27 22:16:40 -07:00
Patrick Wendell
c537e869f3
Missing logo file
2013-06-27 22:02:03 -07:00
Patrick Wendell
c767e74370
Removing incorrect test statement
2013-06-27 21:48:58 -07:00
Patrick Wendell
62c2c6b856
Forcing Jetty to run as daemon
2013-06-27 21:47:22 -07:00
Patrick Wendell
a55190d314
Adding better tabs for UI headers.
2013-06-27 19:14:51 -07:00
Patrick Wendell
362d996c81
Handful of changes based on matei's review
...
- Avoid exception when no tasks have finished for a stage
- Adding DOCTYPE so css renders properly
- Adding progress slider
2013-06-27 19:14:28 -07:00
Patrick Wendell
92a4c2a5f6
Fixing bug in local scheduler time recording
2013-06-27 12:33:06 -07:00
Matei Zaharia
aea727f68d
Simplify Python docs a little to do substring search
2013-06-26 21:15:09 -07:00
Matei Zaharia
03906f7f0a
Fixes to compute-classpath on Windows
2013-06-26 17:40:22 -07:00
Matei Zaharia
e49bc8ca8c
Merge pull request #663 from stephenh/option_and_getenv
...
Be cute with Option and getenv.
2013-06-26 11:13:33 -07:00
Stephen Haberman
d7011632d1
Wrap lines.
2013-06-26 12:35:57 -05:00
Patrick Wendell
ee692482a6
One more private class
2013-06-26 09:07:32 -07:00
Patrick Wendell
a59c15a37e
Adding config option for retained stages
2013-06-26 08:54:57 -07:00
Patrick Wendell
274193664a
Bumping timeouts
2013-06-26 08:51:28 -07:00
Patrick Wendell
b14ad509ba
Moving static ui package
2013-06-26 08:46:51 -07:00
Patrick Wendell
2cbaa0734b
Making all new classes package private
2013-06-26 08:44:55 -07:00
Stephen Haberman
d11025dc6a
Be cute with Option and getenv.
2013-06-26 09:53:35 -05:00
Matei Zaharia
32370da4e4
Don't use forward slash in exclusion for JAR signature files
2013-06-25 22:08:19 -04:00
Matei Zaharia
9f0d913295
Refactored tests to share SparkContexts in some of them
...
Creating these seems to take a while and clutters the output with Akka
stuff, so it would be nice to share them.
2013-06-25 19:18:30 -04:00
Matei Zaharia
2bd04c3513
Formatting
2013-06-25 18:37:14 -04:00
Matei Zaharia
f2263350ed
Added a local-cluster mode test to ReplSuite
2013-06-25 18:35:35 -04:00
Matei Zaharia
6c8d1b2ca6
Fix computation of classpath when we launch java directly
...
The previous version assumed that a CLASSPATH environment variable was
set by the "run" script when launching the process that starts the
ExecutorRunner, but unfortunately this is not true in tests. Instead, we
factor the classpath calculation into an extenral script and call that.
NOTE: This includes a Windows version but hasn't yet been tested there.
2013-06-25 18:21:00 -04:00