seanm
3632980b1b
fixing indentation
2013-05-10 15:54:26 -06:00
Reynold Xin
63e1999f60
Merge pull request #606 from markhamstra/foreachPartition_fix
...
Actually use the cleaned closure in foreachPartition
2013-05-10 13:54:03 -07:00
Mark Hamstra
6e6b3e0d7e
Actually use the cleaned closure in foreachPartition
2013-05-10 13:02:34 -07:00
seanm
b95c1bdbba
count() now uses a transform instead of ConstantInputDStream
2013-05-10 12:47:24 -06:00
seanm
d761e7359d
adding kafkaStream API tests
2013-05-10 12:05:10 -06:00
Joseph E. Gonzalez
0c24305b8d
added documentation to graph and did some minor renaming
2013-05-09 20:14:27 -07:00
Ethan Jewett
ee6f6aa6cd
Add hBase example
2013-05-09 18:33:38 -05:00
Reynold Xin
012c9e5ab0
Revert "Merge pull request #596 from esjewett/master" because the
...
dependency on hbase introduces netty-3.2.2 which conflicts with
netty-3.5.3 already in Spark. This caused multiple test failures.
This reverts commit 0f1b7a06e1
, reversing
changes made to aacca1b8a8
.
2013-05-09 14:20:01 -07:00
Patrick Wendell
2197b2159a
Removing unnecessary parsing
2013-05-09 11:27:13 -07:00
Mridul Muralidharan
b05c9d22d7
Remove explicit hardcoding of yarn-standalone as args(0) if it is missing.
2013-05-09 18:49:12 +05:30
Imran Rashid
0ab818d508
fix linebreak
2013-05-09 00:38:59 -07:00
Patrick Wendell
36c117a1f1
Slight change to AMI versioning
2013-05-08 22:50:53 -07:00
Reynold Xin
42bbe89f04
Merge pull request #599 from JoshRosen/spark-670
...
Fix SPARK-670: EC2 'start' command should require -i option.
2013-05-08 22:30:31 -07:00
Patrick Wendell
f6c965a98b
Changing spark version and availability zone fix
2013-05-08 21:46:01 -07:00
Patrick Wendell
976e02491e
Resolve AMI region automatically
2013-05-08 21:46:01 -07:00
Patrick Wendell
f8213aab4b
Adding automatic resolve of AMI
2013-05-08 21:46:01 -07:00
Patrick Wendell
03b58378d0
Adding mapreduce module
2013-05-08 21:46:01 -07:00
Patrick Wendell
73f8cd237e
Adding extra instance types
2013-05-08 21:46:01 -07:00
Patrick Wendell
9ff8ad4bec
REVERT ME: Linking to Patrick's ec2 repo for now
2013-05-08 21:46:00 -07:00
Matei Zaharia
0f1b7a06e1
Merge pull request #596 from esjewett/master
...
hBase example
2013-05-08 13:38:50 -07:00
Reynold Xin
9cafacf32d
Added test for Netty suite.
2013-05-07 22:42:37 -07:00
Reynold Xin
5d70ee4663
Cleaned up connection manager (moved many classes to their own files).
2013-05-07 22:42:15 -07:00
Reynold Xin
8388e8dd7a
Minor style fix in DiskStore...
2013-05-07 18:40:35 -07:00
Reynold Xin
547dcbe494
Cleaned up Scala files in network/netty from Shane's PR.
2013-05-07 18:39:33 -07:00
Reynold Xin
9e64396ca4
Cleaned up the Java files from Shane's PR.
2013-05-07 18:30:54 -07:00
Reynold Xin
0e5cc30868
Cleaned up BlockManager and BlockFetcherIterator from Shane's PR.
2013-05-07 18:18:24 -07:00
Reynold Xin
8b79485171
Moved BlockFetcherIterator to its own file.
2013-05-07 17:02:32 -07:00
Matei Zaharia
a8e13f6a0b
Merge branch 'master' of github.com:mesos/spark
2013-05-07 19:06:57 -04:00
Reynold Xin
90577ada69
Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark into shufflemerge
...
Conflicts:
core/src/main/scala/spark/storage/BlockManager.scala
core/src/main/scala/spark/storage/DiskStore.scala
project/SparkBuild.scala
2013-05-07 15:56:19 -07:00
Jey Kottalam
aacca1b8a8
Update Maven build to Scala 2.9.3
2013-05-07 14:39:44 -07:00
Ethan Jewett
a3d5f92210
Switch to using SparkContext method to create RDD
2013-05-07 11:43:06 -05:00
Jey Kottalam
4d8919d330
Update Maven build to Scala 2.9.3
2013-05-06 17:05:50 -07:00
Reynold Xin
64d4d2b036
Added tests for joins, cogroups, and unions for EmptyRDD.
2013-05-06 16:30:46 -07:00
Reynold Xin
0fd84965f6
Added EmptyRDD.
2013-05-06 15:40:34 -07:00
Reynold Xin
e93805f2b1
Merge branch 'master' of github.com:mesos/spark
2013-05-06 15:39:38 -07:00
unknown
cbf6a5ee1e
Removed unused code, clarified intent of the program, batch size to 1 second
2013-05-06 08:05:45 -06:00
Reynold Xin
0711fab137
Merge branch 'graph' of github.com:rxin/spark into graph
...
Conflicts:
graph/src/main/scala/spark/graph/Analytics.scala
2013-05-05 17:46:54 -07:00
Reynold Xin
70ba4d1740
Refactored the Graph API for discussion.
2013-05-05 17:12:30 -07:00
Imran Rashid
22a5063ae4
switch from separating appUI host & port to combining into just appUiUrl
2013-05-05 12:19:11 -07:00
Josh Rosen
e014c1d1cb
Fix SPARK-670: EC2 start command should require -i option.
2013-05-05 11:30:36 -07:00
Matei Zaharia
7af92f248b
Merge pull request #597 from JoshRosen/webui-fixes
...
Two minor bug fixes for Spark Web UI
2013-05-04 22:29:17 -07:00
Matei Zaharia
c74ce606a3
Merge pull request #598 from rxin/blockmanager
...
Fixed flaky unpersist test in DistributedSuite.
2013-05-04 22:26:35 -07:00
Reynold Xin
0a2bed356b
Fixed flaky unpersist test in DistributedSuite.
2013-05-04 21:50:08 -07:00
Reynold Xin
62a077cd08
Merge branch 'unpersist-test' of github.com:shivaram/spark into blockmanager
2013-05-04 21:49:50 -07:00
Josh Rosen
42b1953c53
Fix SPARK-630: app details page shows finished executors as running.
2013-05-04 18:34:47 -07:00
Josh Rosen
c0688451a6
Fix wrong closing tags in web UI HTML.
2013-05-04 18:34:46 -07:00
Josh Rosen
d48e9fde01
Fix SPARK-629: weird number of cores in job details page.
2013-05-04 18:34:45 -07:00
Ethan Jewett
7cff7e7897
Fix indents and mention other configuration options
2013-05-04 14:56:55 -05:00
Ethan Jewett
9290f16430
Remove unnecessary column family config
2013-05-04 12:39:14 -05:00
Ethan Jewett
02e8cfa617
HBase example
2013-05-04 12:31:30 -05:00