Patrick Wendell
b7b627d5bb
Updating relevant documentation
2013-07-31 21:28:27 -07:00
Patrick Wendell
893aaff738
Don't install MapReduce for Hadoop1
2013-07-30 14:55:04 -07:00
Patrick Wendell
31b3c1df54
Small improvement in python script
2013-07-17 17:43:15 -07:00
Patrick Wendell
8dccee16af
Bug fix
2013-07-11 16:50:27 -07:00
Patrick Wendell
31c18a2528
Removing support for custom Shark version
2013-07-11 16:18:16 -07:00
Patrick Wendell
13809d363c
Small fix
2013-07-11 15:45:35 -07:00
Patrick Wendell
f1689185d6
Adding ability to custom deploy only Spark
2013-07-11 15:44:31 -07:00
Patrick Wendell
311e63f2c7
Removing mesos terminology
2013-07-11 14:13:10 -07:00
Patrick Wendell
13e3dd98d8
Removing mesos support
2013-06-26 11:36:39 -07:00
Patrick Wendell
d5f74aa9b7
Cleanup of AMI tag
2013-06-13 10:30:59 -07:00
Patrick Wendell
eae7590d0d
Support for multiple hadoop versions
2013-06-12 18:39:01 -07:00
Patrick Wendell
bb328c8ff8
Re-working spark versions to use templates
2013-06-11 20:14:33 -07:00
Patrick Wendell
2124563a00
Remving support for old scripts
2013-06-11 17:52:10 -07:00
Patrick Wendell
8637c02191
Minor doc cleanup
2013-06-07 14:54:26 -07:00
Patrick Wendell
0f4c0e461f
Removing now defunct ami documentation
2013-06-07 14:39:58 -07:00
Patrick Wendell
d65d3dd8f0
Fixing syntax error
2013-06-07 14:16:01 -07:00
Patrick Wendell
2477736237
Adding spark shark modules
2013-06-07 11:55:46 -07:00
Patrick Wendell
db50379737
Decoupling spark version from ami
2013-06-07 11:54:16 -07:00
Patrick Wendell
a07bd286bb
Some changes in response to Josh
2013-05-18 16:00:32 -07:00
Patrick Wendell
e8a1d02956
Adding support for tag
2013-05-10 15:13:22 -07:00
Patrick Wendell
2197b2159a
Removing unnecessary parsing
2013-05-09 11:27:13 -07:00
Patrick Wendell
36c117a1f1
Slight change to AMI versioning
2013-05-08 22:50:53 -07:00
Patrick Wendell
f6c965a98b
Changing spark version and availability zone fix
2013-05-08 21:46:01 -07:00
Patrick Wendell
976e02491e
Resolve AMI region automatically
2013-05-08 21:46:01 -07:00
Patrick Wendell
f8213aab4b
Adding automatic resolve of AMI
2013-05-08 21:46:01 -07:00
Patrick Wendell
03b58378d0
Adding mapreduce module
2013-05-08 21:46:01 -07:00
Patrick Wendell
73f8cd237e
Adding extra instance types
2013-05-08 21:46:01 -07:00
Patrick Wendell
9ff8ad4bec
REVERT ME: Linking to Patrick's ec2 repo for now
2013-05-08 21:46:00 -07:00
Matei Zaharia
f708dda81e
Merge pull request #585 from pwendell/listener-perf
...
[Fix SPARK-742] Task Metrics should not employ per-record timing by default
2013-04-30 07:51:40 -07:00
Matei Zaharia
f1f92c88eb
Build against Hadoop 1 by default
2013-04-29 17:08:45 -07:00
Patrick Wendell
016ce1fa9c
Using full package name for util
2013-04-29 12:02:27 -07:00
Patrick Wendell
540be6b154
Modified version of the fix which just removes all per-record tracking.
2013-04-29 11:32:07 -07:00
Patrick Wendell
224fbac061
Spark-742: TaskMetrics should not employ per-record timing.
...
This patch does three things:
1. Makes TimedIterator a trait with two implementations (one a no-op)
2. Makes the default behavior to use the no-op implementation
3. Removes DelegateBlockFetchTracker. This is just cleanup, but it seems like
the triat doesn't really reduce complexity in any way.
In the future we can add other implementations, e.g. ones which perform sampling.
2013-04-29 11:13:43 -07:00
Matei Zaharia
0f45347c7b
More unit test fixes
2013-04-28 22:29:27 -07:00
Matei Zaharia
bce4089f22
Fix BlockManagerSuite to deal with clearing spark.hostPort
2013-04-28 22:23:48 -07:00
Matei Zaharia
68c07ea198
Merge pull request #582 from shivaram/master
...
Add zip partitions interface
2013-04-28 20:19:33 -07:00
Shivaram Venkataraman
604d3bf56c
Rename partition class and add scala doc
2013-04-28 16:31:07 -07:00
Shivaram Venkataraman
15acd49f07
Actually rename classes to ZippedPartitions*
...
(the previous commit only renamed the file)
2013-04-28 16:03:22 -07:00
Shivaram Venkataraman
6e84635ab9
Rename classes from MapZipped* to Zipped*
2013-04-28 15:58:40 -07:00
Matei Zaharia
f6ee9a8728
Merge pull request #583 from mridulm/master
...
Fix issues with streaming test cases after yarn branch merge
2013-04-28 15:36:04 -07:00
Mridul Muralidharan
430c531464
Remove debug statements
2013-04-29 00:24:30 +05:30
Mridul Muralidharan
3a89a76b87
Make log message more descriptive to aid in debugging
2013-04-29 00:04:12 +05:30
Mridul Muralidharan
9bd439502e
Remove spurious commit
2013-04-28 23:09:08 +05:30
Mridul Muralidharan
7fa6978a1e
Allow CheckpointWriter pending tasks to finish
2013-04-28 23:08:10 +05:30
Mridul Muralidharan
00c7a37604
Merge branch 'master' of github.com:mridulm/spark
2013-04-28 22:44:34 +05:30
Mridul Muralidharan
afee902443
Attempt to fix streaming test failures after yarn branch merge
2013-04-28 22:26:45 +05:30
Shivaram Venkataraman
0cc6642b7c
Rename to zipPartitions and style changes
2013-04-28 05:11:03 -07:00
Shivaram Venkataraman
c9c4954d99
Add an interface to zip iterators of multiple RDDs
...
The current code supports 2, 3 or 4 arguments but can be extended
to more arguments if required.
2013-04-26 16:57:46 -07:00
Matei Zaharia
1f20ef2567
Merge branch 'master' of github.com:mesos/spark
2013-04-25 20:03:13 -07:00
Matei Zaharia
1b169f190c
Exclude old versions of Netty, which had a different Maven organization
2013-04-25 19:52:12 -07:00