Patrick Wendell
13e3dd98d8
Removing mesos support
2013-06-26 11:36:39 -07:00
Patrick Wendell
d5f74aa9b7
Cleanup of AMI tag
2013-06-13 10:30:59 -07:00
Patrick Wendell
eae7590d0d
Support for multiple hadoop versions
2013-06-12 18:39:01 -07:00
Patrick Wendell
bb328c8ff8
Re-working spark versions to use templates
2013-06-11 20:14:33 -07:00
Patrick Wendell
2124563a00
Remving support for old scripts
2013-06-11 17:52:10 -07:00
Patrick Wendell
8637c02191
Minor doc cleanup
2013-06-07 14:54:26 -07:00
Patrick Wendell
0f4c0e461f
Removing now defunct ami documentation
2013-06-07 14:39:58 -07:00
Patrick Wendell
d65d3dd8f0
Fixing syntax error
2013-06-07 14:16:01 -07:00
Patrick Wendell
2477736237
Adding spark shark modules
2013-06-07 11:55:46 -07:00
Patrick Wendell
db50379737
Decoupling spark version from ami
2013-06-07 11:54:16 -07:00
Patrick Wendell
a07bd286bb
Some changes in response to Josh
2013-05-18 16:00:32 -07:00
Patrick Wendell
e8a1d02956
Adding support for tag
2013-05-10 15:13:22 -07:00
Patrick Wendell
2197b2159a
Removing unnecessary parsing
2013-05-09 11:27:13 -07:00
Patrick Wendell
36c117a1f1
Slight change to AMI versioning
2013-05-08 22:50:53 -07:00
Patrick Wendell
f6c965a98b
Changing spark version and availability zone fix
2013-05-08 21:46:01 -07:00
Patrick Wendell
976e02491e
Resolve AMI region automatically
2013-05-08 21:46:01 -07:00
Patrick Wendell
f8213aab4b
Adding automatic resolve of AMI
2013-05-08 21:46:01 -07:00
Patrick Wendell
03b58378d0
Adding mapreduce module
2013-05-08 21:46:01 -07:00
Patrick Wendell
73f8cd237e
Adding extra instance types
2013-05-08 21:46:01 -07:00
Patrick Wendell
9ff8ad4bec
REVERT ME: Linking to Patrick's ec2 repo for now
2013-05-08 21:46:00 -07:00
Matei Zaharia
f708dda81e
Merge pull request #585 from pwendell/listener-perf
...
[Fix SPARK-742] Task Metrics should not employ per-record timing by default
2013-04-30 07:51:40 -07:00
Matei Zaharia
f1f92c88eb
Build against Hadoop 1 by default
2013-04-29 17:08:45 -07:00
Patrick Wendell
016ce1fa9c
Using full package name for util
2013-04-29 12:02:27 -07:00
Patrick Wendell
540be6b154
Modified version of the fix which just removes all per-record tracking.
2013-04-29 11:32:07 -07:00
Patrick Wendell
224fbac061
Spark-742: TaskMetrics should not employ per-record timing.
...
This patch does three things:
1. Makes TimedIterator a trait with two implementations (one a no-op)
2. Makes the default behavior to use the no-op implementation
3. Removes DelegateBlockFetchTracker. This is just cleanup, but it seems like
the triat doesn't really reduce complexity in any way.
In the future we can add other implementations, e.g. ones which perform sampling.
2013-04-29 11:13:43 -07:00
Matei Zaharia
0f45347c7b
More unit test fixes
2013-04-28 22:29:27 -07:00
Matei Zaharia
bce4089f22
Fix BlockManagerSuite to deal with clearing spark.hostPort
2013-04-28 22:23:48 -07:00
Matei Zaharia
68c07ea198
Merge pull request #582 from shivaram/master
...
Add zip partitions interface
2013-04-28 20:19:33 -07:00
Shivaram Venkataraman
604d3bf56c
Rename partition class and add scala doc
2013-04-28 16:31:07 -07:00
Shivaram Venkataraman
15acd49f07
Actually rename classes to ZippedPartitions*
...
(the previous commit only renamed the file)
2013-04-28 16:03:22 -07:00
Shivaram Venkataraman
6e84635ab9
Rename classes from MapZipped* to Zipped*
2013-04-28 15:58:40 -07:00
Matei Zaharia
f6ee9a8728
Merge pull request #583 from mridulm/master
...
Fix issues with streaming test cases after yarn branch merge
2013-04-28 15:36:04 -07:00
Mridul Muralidharan
430c531464
Remove debug statements
2013-04-29 00:24:30 +05:30
Mridul Muralidharan
3a89a76b87
Make log message more descriptive to aid in debugging
2013-04-29 00:04:12 +05:30
Mridul Muralidharan
9bd439502e
Remove spurious commit
2013-04-28 23:09:08 +05:30
Mridul Muralidharan
7fa6978a1e
Allow CheckpointWriter pending tasks to finish
2013-04-28 23:08:10 +05:30
Mridul Muralidharan
00c7a37604
Merge branch 'master' of github.com:mridulm/spark
2013-04-28 22:44:34 +05:30
Mridul Muralidharan
afee902443
Attempt to fix streaming test failures after yarn branch merge
2013-04-28 22:26:45 +05:30
Shivaram Venkataraman
0cc6642b7c
Rename to zipPartitions and style changes
2013-04-28 05:11:03 -07:00
Shivaram Venkataraman
c9c4954d99
Add an interface to zip iterators of multiple RDDs
...
The current code supports 2, 3 or 4 arguments but can be extended
to more arguments if required.
2013-04-26 16:57:46 -07:00
Matei Zaharia
1f20ef2567
Merge branch 'master' of github.com:mesos/spark
2013-04-25 20:03:13 -07:00
Matei Zaharia
1b169f190c
Exclude old versions of Netty, which had a different Maven organization
2013-04-25 19:52:12 -07:00
Matei Zaharia
cf54b824ff
Merge pull request #580 from pwendell/quickstart
...
SPARK-739 Have quickstart standlone job use README
2013-04-25 11:45:58 -07:00
Patrick Wendell
a72134a6ac
SPARK-739 Have quickstart standlone job use README
2013-04-25 10:39:28 -07:00
Matei Zaharia
6e6b5204ea
Create an empty directory when checkpointing a 0-partition RDD (fixes a
...
test failure on Hadoop 2.0)
2013-04-25 00:42:37 -07:00
Matei Zaharia
eef9ea1993
Update unit test memory to 2 GB
2013-04-25 00:42:29 -07:00
Matei Zaharia
01d9ba5038
Add back line removed during YARN merge
2013-04-25 00:11:27 -07:00
Matei Zaharia
118a6c76f5
Merge pull request #575 from mridulm/master
...
Manual merge of yarn branch to trunk
2013-04-24 08:42:30 -07:00
Mridul Muralidharan
3b594a4e3b
Do not add signature files - results in validation errors when using assembled file
2013-04-24 10:18:25 +05:30
Mridul Muralidharan
dd515ca3ee
Attempt at fixing merge conflict
2013-04-24 09:24:17 +05:30
