ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
2876 commits 6 branches 181 tags 397 MiB
Commit graph

2876 commits

This branch
This branch
All branches
Author SHA1 Message Date
Joseph E. Gonzalez c649073b5f merged with trunk 2013-04-03 08:47:49 -07:00
Joseph E. Gonzalez 0123c9d6a1 Changed GraphLab class to object and added graph loading from text file. 2013-04-03 08:43:08 -07:00
Reynold Xin fe42ad41bb Commit a working version. 2013-04-03 23:40:09 +08:00
Reynold Xin cb0efe92d1 Oh wow it finally compiles! 2013-04-03 23:12:01 +08:00
Nick Pentreath 0f54344fd8 Bumping Algebird version in examples now that it supports JDK 1.6 2013-04-03 13:15:34 +02:00
Matei Zaharia dfe98ca798 Merge pull request #550 from erikvanoosten/master 
corrected Algebird example
 2013-04-02 19:24:12 -07:00
Matei Zaharia b5d78307ca Merge pull request #551 from jey/python-bugfixes 
Python bugfixes
 2013-04-02 19:23:45 -07:00
Jey Kottalam 9a731f5a6d Fix Python saveAsTextFile doctest to not expect order to be preserved 2013-04-02 11:59:20 -07:00
Jey Kottalam 20604001e2 Fix argv handling in Python transitive closure example 2013-04-02 11:59:07 -07:00
Reynold Xin d63c895945 Partial checkin of graphlab module. 2013-04-03 00:42:33 +08:00
Erik van oosten b5e60c3253 Corrected order of CountMinSketchMonoid arguments 2013-04-02 15:25:22 +03:00
Andrew xia 2b373dd07a add properties default value null to fix sbt/sbt test errors 2013-04-02 12:11:14 +08:00
Reynold Xin 25c71b185d Added a vertices method to Graph. 2013-04-02 01:26:20 +08:00
Reynold Xin d7011b0f78 Added a Graph class that supports joining vertices with edges. 2013-04-02 01:17:44 +08:00
Reynold Xin 28ebe04496 Added a Graph class that supports joining vertices with edges. 2013-04-02 01:16:08 +08:00
Reynold Xin f130eb624c Merge branch 'master' of github.com:mesos/spark into graph 2013-04-01 20:06:30 +08:00
Matei Zaharia 2be2295ff2 Merge pull request #548 from markhamstra/getWritableClass_filter 
Fixed broken filter in getWritableClass[T]
 2013-03-31 18:09:14 -07:00
Mark Hamstra e215f67923 Correct sense of 'filter out' in comment. 2013-03-31 08:00:13 -07:00
Mark Hamstra 8bcdc64005 Fixed broken filter in getWritableClass[T] 2013-03-30 22:09:52 -07:00
Matei Zaharia 9831bc1a09 Merge pull request #539 from cgrothaus/fix-webui-workdirpath 
Bugfix: WorkerWebUI must respect workDirPath from Worker
 2013-03-29 22:16:22 -07:00
Matei Zaharia 3cc8ab6e29 Merge pull request #541 from stephenh/shufflecoalesce 
Add a shuffle parameter to coalesce.
 2013-03-29 22:14:07 -07:00
Matei Zaharia cad507adaf Merge pull request #547 from jey/maven-streaming-tests-initialization-fix 
Move streaming test initialization into 'before' blocks
 2013-03-29 22:13:12 -07:00
Matei Zaharia a98996d1fe Merge pull request #545 from ash211/patch-1 
Don't use deprecated Application in example
 2013-03-29 22:12:15 -07:00
Matei Zaharia 104c69414f Merge pull request #546 from ash211/patch-2 
Update tuning.md
 2013-03-29 22:11:50 -07:00
Andrew xia 1a28f92711 change some typo and some spacing 2013-03-29 08:34:28 +08:00
Andrew xia def3d1c84a 1.remove redundant spacing in source code 
2.replace get/set functions with val and var defination
 2013-03-29 08:20:35 +08:00
Jey Kottalam bc8ba222ff Bump development version to 0.8.0 2013-03-28 15:42:01 -07:00
Andrew Ash e8f3669c63 Update tuning.md 
Make the example more compilable
 2013-03-28 19:17:39 -03:00
Jey Kottalam b569b3f200 Move streaming test initialization into 'before' blocks 2013-03-28 15:08:41 -07:00
Andrew Ash 4e2c965383 Don't use deprecated Application in example 
As of 2.9.0 extending from Application is not recommended

http://www.scala-lang.org/api/2.9.3/index.html#scala.Application
 2013-03-28 17:47:37 -03:00
kalpit aa9134f72a spark instance number must be present in log filename to prevent multiple workers from overriding each other's logs 2013-03-26 17:49:30 -07:00
kalpit f08db010d3 added SPARK_WORKER_INSTANCES : allows spawning multiple worker instances/processes on every slave machine 2013-03-26 17:49:30 -07:00
kalpit f0164e5047 upgraded sbt version, sbt plugins and some library dependencies to latest stable version 2013-03-26 17:49:29 -07:00
Matei Zaharia bc36ee4fbb Merge pull request #543 from holdenk/master 
Re-enable deprecation warnings and fix deprecated warning.
 2013-03-26 15:05:13 -07:00
Andy Konwinski 6c18131487 Add comment to README that 2.10 not yet supported 2013-03-26 14:28:08 -07:00
Holden Karau 1f5381119f method first in trait IterableLike is deprecated: use `head' instead 2013-03-24 19:19:40 -07:00
Holden Karau 8456d673e2 Re-enable deprecation warnings since there are only two 2013-03-24 17:30:23 -07:00
Holden Karau e104a76016 Makes the syntax highlighting on the build file not broken in emacs. 2013-03-24 16:16:05 -07:00
Holden Karau f5df729b12 Explicitly catch all throwables (warning in 2.10) 2013-03-24 16:15:32 -07:00
Stephen Haberman dd854d5b9f Use Boolean in the Java API, and != for assert. 2013-03-23 11:49:45 -05:00
Stephen Haberman 4ca273edc4 Merge branch 'master' into shufflecoalesce 
Conflicts:
	core/src/test/scala/spark/RDDSuite.scala
 2013-03-23 11:45:45 -05:00
Matei Zaharia b8949cab88 Merge pull request #505 from stephenh/volatile 
Make Executor fields volatile since they're read from the thread pool.
 2013-03-23 07:19:34 -07:00
Matei Zaharia fd53f2fc7b Merge pull request #510 from markhamstra/WithThing 
mapWith, flatMapWith and filterWith
 2013-03-23 07:13:21 -07:00
Andrew xia d1d9bdaabe Just update typo and comments 2013-03-23 07:25:30 +08:00
Stephen Haberman 00170eb0b9 Fix are/our typo. 2013-03-22 12:59:08 -05:00
Stephen Haberman 1c67c7dfd1 Add a shuffle parameter to coalesce. 
This is useful for when you want just 1 output file (part-00000) but
still up the upstream RDD to be computed in parallel.
 2013-03-22 08:54:44 -05:00
Christoph Grothaus 445f387ef4 Bugfix: WorkerWebUI must respect workDirPath from Worker 2013-03-22 11:08:40 +01:00
Matei Zaharia 4c5efcf600 Merge pull request #532 from andyk/master 
SPARK-715: Adds instructions for building with Maven to documentation
 2013-03-20 19:29:23 -07:00
Matei Zaharia 35588490cb Merge pull request #538 from rxin/cogroup 
Added mapSideCombine flag to CoGroupedRDD. Added unit test for CoGroupedRDD.
 2013-03-20 19:27:47 -07:00
Andy Konwinski 446b801b3b Fixing typos pointed out by Matei 2013-03-20 17:30:31 -07:00