ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

[MINOR][DOC] Documentation on JVM options for SBT

Browse source 
## What changes were proposed in this pull request?

Documentation and .gitignore

## How was this patch tested?

Manual test that SBT honors the settings in .jvmopts if present

Closes #23615 from sadhen/impr/gitignore.

Authored-by: Darcy Shen <sadhen@zoho.com>
Signed-off-by: Sean Owen <sean.owen@databricks.com>
This commit is contained in:
Darcy Shen 2019-01-22 18:27:24 -06:00 committed by Sean Owen
parent 02d8ae3d59
commit 9d2a11554b
2 changed files with 11 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
.gitignore vendored
View file

@ -94,3 +94,6 @@ spark-warehouse/
*.Rproj.* *.Rproj.*
.Rproj.user .Rproj.user
# For SBT
.jvmopts

8
docs/building-spark.md
View file

@ -138,6 +138,14 @@ To avoid the overhead of launching sbt each time you need to re-compile, you can
in interactive mode by running `build/sbt`, and then run all build commands at the command in interactive mode by running `build/sbt`, and then run all build commands at the command
prompt. prompt.
### Setting up SBT's Memory Usage
Configure the JVM options for SBT in `.jvmopts` at the project root, for example:
-Xmx2g
-XX:ReservedCodeCacheSize=512m
For the meanings of these two options, please carefully read the [Setting up Maven's Memory Usage section](http://spark.apache.org/docs/latest/building-spark.html#setting-up-mavens-memory-usage).
## Speeding up Compilation ## Speeding up Compilation
Developers who compile Spark frequently may want to speed up compilation; e.g., by using Zinc Developers who compile Spark frequently may want to speed up compilation; e.g., by using Zinc