Matei Zaharia
2615cad30b
Some doc improvements
...
- List higher-level projects that run on Spark
- Tweak CSS
2013-09-02 13:35:28 -07:00
Matei Zaharia
12b2f1f9c9
Add missing license headers found with RAT
2013-09-02 12:23:03 -07:00
Matei Zaharia
2ba695292a
Exclude some private modules in epydoc
2013-09-02 12:22:52 -07:00
Matei Zaharia
636fc0c89e
Merge pull request #886 from mateiz/codec
...
Fix spark.io.compression.codec and change default codec to LZF
2013-09-02 11:20:39 -07:00
Matei Zaharia
246bf67f58
Fix test
2013-09-02 10:57:34 -07:00
Matei Zaharia
9329a7d4cd
Fix spark.io.compression.codec and change default codec to LZF
2013-09-02 10:15:22 -07:00
Matei Zaharia
d9a53b94f8
Merge pull request #885 from mateiz/win-py
...
Allow PySpark to run on Windows
2013-09-01 22:12:30 -07:00
Matei Zaharia
9ee1e9db2e
Doc improvements
2013-09-01 22:12:03 -07:00
Matei Zaharia
141f54279e
Further fixes to get PySpark to work on Windows
2013-09-02 01:19:29 +00:00
Matei Zaharia
6550e5e60c
Allow PySpark to launch worker.py directly on Windows
2013-09-01 18:06:15 -07:00
Matei Zaharia
3c520fea77
Merge pull request #884 from mateiz/win-fixes
...
Run script fixes for Windows after package & assembly change
2013-09-01 17:26:55 -07:00
Matei Zaharia
3db404a43a
Run script fixes for Windows after package & assembly change
2013-09-01 23:45:57 +00:00
Matei Zaharia
2ce200bf7f
Merge remote-tracking branch 'old/master'
2013-09-01 14:57:27 -07:00
Matei Zaharia
f957c26fa2
Merge pull request #882 from mateiz/package-rename
...
Rename spark package to org.apache.spark
2013-09-01 14:53:57 -07:00
Matei Zaharia
0a8cc30921
Move some classes to more appropriate packages:
...
* RDD, *RDDFunctions -> org.apache.spark.rdd
* Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util
* JavaSerializer, KryoSerializer -> org.apache.spark.serializer
2013-09-01 14:13:16 -07:00
Matei Zaharia
5b4dea2143
More fixes
2013-09-01 14:13:16 -07:00
Matei Zaharia
5701eb92c7
Fix some URLs
2013-09-01 14:13:16 -07:00
Matei Zaharia
debcf24389
Fix over-zealous find-and-replace in HTML
2013-09-01 14:13:16 -07:00
Matei Zaharia
d27cd03f30
Fix more URLs in docs
2013-09-01 14:13:16 -07:00
Matei Zaharia
bbaa9d7d6e
Add banner to PySpark and make wordcount output nicer
2013-09-01 14:13:16 -07:00
Matei Zaharia
12495ec63a
Remove shutdown hook to stop jetty; this is unnecessary for releasing
...
ports and creates noisy log messages
2013-09-01 14:13:15 -07:00
Matei Zaharia
4f422032e5
Update docs for new package
2013-09-01 14:13:15 -07:00
Matei Zaharia
4d1cb59fe1
Small tweak to docs gradient
2013-09-01 14:13:15 -07:00
Matei Zaharia
46eecd110a
Initial work to rename package to org.apache.spark
2013-09-01 14:13:13 -07:00
Matei Zaharia
a30fac16ca
Merge pull request #883 from alig/master
...
Don't require the spark home environment variable to be set for standalone mode (change needed by SIMR)
2013-09-01 12:27:50 -07:00
Matei Zaharia
03cc76506a
Merge pull request #881 from pwendell/master
...
Extend QuickStart to include next steps
2013-09-01 10:20:56 -07:00
Patrick Wendell
0e375a3cc2
Add assmebly plug in links
2013-09-01 09:43:42 -07:00
Patrick Wendell
6371febe18
Better docs
2013-08-31 19:09:06 -07:00
Matei Zaharia
0e9565a704
Merge pull request #880 from mateiz/ui-tweaks
...
Various UI tweaks
2013-08-31 18:55:41 -07:00
Matei Zaharia
2c5a4b89ee
Small fixes to README
2013-08-31 18:08:05 -07:00
Matei Zaharia
2b29a1d43f
Merge pull request #877 from mateiz/docs
...
Doc improvements for 0.8
2013-08-31 17:49:45 -07:00
Matei Zaharia
e34bc3a8ee
Small tweak
2013-08-31 17:47:15 -07:00
Matei Zaharia
7862c4a3c8
Another fix suggested by Patrick
2013-08-31 17:41:47 -07:00
Matei Zaharia
9ddad0dcb4
Fixes suggested by Patrick
2013-08-31 17:40:33 -07:00
Matei Zaharia
2ee6a7e32a
Print output from spark-daemon only when it fails to launch
2013-08-31 17:31:07 -07:00
Ali Ghodsi
250bddc255
Don't require spark home to be set for standalone mode
2013-08-31 17:29:05 -07:00
Matei Zaharia
25ac50668b
Various web UI improvements:
...
- Use "fluid" layout that can expand to wide browser windows, instead of
the old one's limit of 1200 px
- Remove unnecessary <hr> elements
- Switch back to Bootstrap's default theme and tweak progress bar colors
- Make headers more consistent between deploy and app UIs
- Replace some inline CSS with stylesheets
2013-08-31 16:55:40 -07:00
Matei Zaharia
89a20b83e9
Delete some code that was added back in a merge and print less info in
...
spark-daemon
2013-08-31 16:55:25 -07:00
Matei Zaharia
4819baa658
More updates, describing changes to recommended use of environment vars
...
and new Python stuff
2013-08-31 14:21:10 -07:00
Matei Zaharia
6edef9c833
Merge pull request #861 from AndreSchumacher/pyspark_sampling_function
...
Pyspark sampling function
2013-08-31 13:39:24 -07:00
Matei Zaharia
fd89835965
Merge pull request #870 from JoshRosen/spark-885
...
Don't send SIGINT / ctrl-c to Py4J gateway subprocess
2013-08-31 13:18:12 -07:00
Matei Zaharia
618f0ecb43
Merge pull request #869 from AndreSchumacher/subtract
...
PySpark: implementing subtractByKey(), subtract() and keyBy()
2013-08-30 18:17:13 -07:00
Matei Zaharia
4293533032
Update docs about HDFS versions
2013-08-30 15:04:43 -07:00
Reynold Xin
205dba352f
Update README.
2013-08-30 14:51:15 -07:00
Y.CORP.YAHOO.COM\tgraves
96452eea56
fix up minor things
2013-08-30 16:04:31 -05:00
Y.CORP.YAHOO.COM\tgraves
bac46266a9
Link the Spark UI to the Yarn UI
2013-08-30 15:55:32 -05:00
Matei Zaharia
f3a964848d
More doc improvements + better warnings when you haven't built Spark
2013-08-30 12:41:25 -07:00
Reynold Xin
94bb7fd46e
Merge pull request #876 from mbautin/master_hadoop_rdd_conf
...
Make HadoopRDD's configuration accessible
2013-08-30 12:05:13 -07:00
Mikhail Bautin
35090958b3
Also add getConf to NewHadoopRDD
2013-08-30 11:03:57 -07:00
Mikhail Bautin
5e30172f70
Make HadoopRDD's configuration accessible
2013-08-30 11:01:06 -07:00