Patrick Wendell
f78edf94cf
A Spark "Quick Start" example
...
This commit includes a quick start example that covers:
1) Basic usage of the Spark shell
2) A simple Spark job in Scala
3) A simple Spark job in Java
2012-10-01 17:24:09 -07:00
Matei Zaharia
802aa8aef9
Some bug fixes and logging fixes for broadcast.
2012-10-01 15:20:42 -07:00
Reynold Xin
f5812d0354
Added mapPartitionsWithSplit to the programming guide.
2012-09-29 01:31:36 -07:00
Josh Rosen
37c199bbb0
Allow controlling number of splits in distinct().
2012-09-28 23:44:19 -07:00
Matei Zaharia
009b0e37e7
Added an option to compress blocks in the block store
2012-09-27 18:45:44 -07:00
Matei Zaharia
7bcb08cef5
Renamed storage levels to something cleaner; fixes #223 .
2012-09-27 17:50:59 -07:00
Matei Zaharia
bf18e0994e
Minor typos
2012-09-26 23:53:38 -07:00
Matei Zaharia
a4093f7563
Minor doc fixes
2012-09-26 23:22:15 -07:00
Matei Zaharia
ea05fc130b
Updates to standalone cluster, web UI and deploy docs.
2012-09-26 22:54:39 -07:00
Matei Zaharia
874a9fd407
More updates to docs, including tuning guide
2012-09-26 19:17:58 -07:00
Matei Zaharia
58eb44acbb
Doc tweaks
2012-09-26 00:32:59 -07:00
Matei Zaharia
d51d5e0582
Doc fixes
2012-09-25 23:59:04 -07:00
Matei Zaharia
c5754bb939
Fixes to Java guide
2012-09-25 23:51:04 -07:00
Matei Zaharia
f1246cc7c1
Various enhancements to the programming guide and HTML/CSS
2012-09-25 23:26:56 -07:00
Matei Zaharia
56c90485fd
More updates to documentation
2012-09-25 19:31:07 -07:00
Matei Zaharia
1821bf1f1f
Merge branch 'dev' of github.com:mesos/spark into dev
2012-09-25 15:46:27 -07:00
Matei Zaharia
e47e11720f
Documentation updates
2012-09-25 15:46:18 -07:00
Andy Konwinski
098351b735
Makes nav menu dropdowns show on hover instead of on click.
2012-09-25 15:42:50 -07:00
Matei Zaharia
30362a21e7
Update license info on deploy scripts
2012-09-25 14:43:47 -07:00
Matei Zaharia
60bce9574f
Update Jekyll plugin to look at Scala 2.9.2 docs
2012-09-25 14:31:53 -07:00
Josh Rosen
c94e9cc54a
Add Java Programming Guide; fix broken doc links.
2012-09-16 20:46:46 -07:00
Andy Konwinski
52c29071a4
- Add docs/api to .gitignore
...
- Rework/expand the nav bar with more of the docs site
- Removing parts of docs about EC2 and Mesos that differentiate between
running 0.5 and before
- Merged subheadings from running-on-amazon-ec2.html that are still relevant
(i.e., "Using a newer version of Spark" and "Accessing Data in S3") into
ec2-scripts.html and deleted running-on-amazon-ec2.html
- Added some TODO comments to a few docs
- Updated the blurb about AMP Camp
- Renamed programming-guide to spark-programming-guide
- Fixing typos/etc. in Standalone Spark doc
2012-09-16 15:28:52 -07:00
Andy Konwinski
6765d9727e
Adds a jekyll plugin (written in Ruby) to the _plugins directory
...
which generates scala doc by calling `sbt/sbt doc`, copies it over
to docs, and updates the links from the api webpage to now point to
the copied over scaladoc (making the _site directory easy to just
copy over to a public website).
2012-09-13 17:17:58 -07:00
Andy Konwinski
462cd8be60
Re-enabling responsive for better looking padding and more sane resizing,
...
but removed the collapsable stuff from the nav bar.
2012-09-13 15:39:35 -07:00
Andy Konwinski
5ec7a6665b
More crisp logo created from vector source (ai) and disabled
...
responsive css (so nav menu doesn't switch to collapsed version
for narrow viewports).
2012-09-13 15:27:33 -07:00
Andy Konwinski
b0207e2bfd
Replaces "Spark" word in nav bar with logo.
2012-09-13 12:08:12 -07:00
Andy Konwinski
130f2f2f41
Merge remote-tracking branch 'public-spark/dev' into doc
2012-09-13 11:29:25 -07:00
Denny
638a8511fa
Fixed navbar style problem
2012-09-13 09:56:27 -07:00
Denny
6d53b971b9
Added standalone and YARN docs. Merged standalone cluster into standalone doc
2012-09-13 09:47:54 -07:00
Andy Konwinski
ca2c999e0f
Making the link to api scaladocs work and migrating other code snippets
...
to use pygments syntax highlighting.
2012-09-12 23:25:07 -07:00
Andy Konwinski
c4db09ea76
Adds ec2-scripts.md back (it was mistakenly removed earlier due to
...
git weirdness).
2012-09-12 20:56:32 -07:00
Matei Zaharia
d3db46fdef
Remove title from content in Bagel
2012-09-12 19:50:38 -07:00
Matei Zaharia
88181bee9e
Small tweaks to generated doc pages
2012-09-12 19:47:31 -07:00
Andy Konwinski
1bcd09e093
Merge remote-tracking branch 'public-spark/dev' into doc
2012-09-12 19:28:55 -07:00
Andy Konwinski
35adccd008
Adds syntax highlighting (via pygments), and some style tweaks to make things
...
easier to read.
2012-09-12 19:27:44 -07:00
Reynold Xin
4b8b0d5c08
Added a link to AMPCamp website in Spark docs.
2012-09-12 17:54:16 -07:00
Andy Konwinski
95c5a376b5
Fixing a hanging sentence in docs/ec2-scripts.md
2012-09-12 16:17:24 -07:00
Andy Konwinski
3c7e40fa27
Removed the upper-case version of docs/EC2-Scripts.md.
2012-09-12 16:09:34 -07:00
Andy Konwinski
4d3a17c8d7
Fixing lots of broken links.
2012-09-12 16:06:18 -07:00
Andy Konwinski
49e98500a9
Updated base README to point to documentation site instead of wiki, updated
...
docs/README.md to describe use of Jekyll, and renmaed things to make them
more consistent with the lower-case-with-hyphens convention.
2012-09-12 13:03:43 -07:00
Andy Konwinski
16da942d66
Adding docs directory containing documentation currently on the wiki
...
which can be compiled via jekyll, using the command `jekyll`. To compile
and run a local webserver to serve the doc as a website, run
`jekyll --server`.
2012-09-12 13:03:43 -07:00
