c040593fb4
### What changes were proposed in this pull request? Edit spark-env.sh.template for better documentation. ### Why are the changes needed? Some options (e.g. SPARK_CONF_DIR, SPARK_EXECUTOR_CORES, etc.) are read by any mode but are in the "Options read in YARN client/cluster mode" that might confuse users, so we should separate YARN only options from others. ### Does this PR introduce _any_ user-facing change? Yes, docs changed. ### How was this patch tested? Just a manual checking. <img width="336" alt="options" src="https://user-images.githubusercontent.com/87687356/127804872-02a27337-f304-47df-affa-a8c4e9e98fe5.png"> Closes #33604 from yutoacts/SPARK-36377. Authored-by: Yuto Akutsu <yuto.akutsu@nttdata.com> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org> |
||
---|---|---|
.. | ||
fairscheduler.xml.template | ||
log4j.properties.template | ||
metrics.properties.template | ||
spark-defaults.conf.template | ||
spark-env.sh.template | ||
workers.template |