spark-instrumented-optimizer/dev/create-release
Nicholas Chammas 7892f88f84 [SPARK-30879][DOCS] Refine workflow for building docs
### What changes were proposed in this pull request?

This PR makes the following refinements to the workflow for building docs:
* Install Python and Ruby consistently using pyenv and rbenv across both the docs README and the release Dockerfile.
* Pin the Python and Ruby versions we use.
* Pin all direct Python and Ruby dependency versions.
* Eliminate any use of `sudo pip`, which the Python community discourages, or `sudo gem`.

### Why are the changes needed?

This PR should increase the consistency and reproducibility of the doc-building process by managing Python and Ruby in a more consistent way, and by eliminating unused or outdated code.

Here's a possible example of an issue building the docs that would be addressed by the changes in this PR: https://github.com/apache/spark/pull/27459#discussion_r376135719

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

Manual tests:
* I was able to build the Docker image successfully, minus the final part about `RUN useradd`.
    * I am unable to run `do-release-docker.sh` because I am not a committer and don't have the required GPG key.
* I built the docs locally and viewed them in the browser.

I think I need a committer to more fully test out these changes.

Closes #27534 from nchammas/SPARK-30731-building-docs.

Authored-by: Nicholas Chammas <nicholas.chammas@liveramp.com>
Signed-off-by: Sean Owen <srowen@gmail.com>
2020-03-07 11:43:32 -06:00
..
spark-rm [SPARK-30879][DOCS] Refine workflow for building docs 2020-03-07 11:43:32 -06:00
announce.tmpl [SPARK-28951][INFRA] Add release announce template 2019-09-02 14:55:05 -07:00
do-release-docker.sh [SPARK-30879][DOCS] Refine workflow for building docs 2020-03-07 11:43:32 -06:00
do-release.sh [SPARK-24372][BUILD] Add scripts to help with preparing releases. 2018-06-22 12:38:34 -05:00
generate-contributors.py [SPARK-25238][PYTHON] lint-python: Fix W605 warnings for pycodestyle 2.4 2018-09-13 11:19:43 +08:00
known_translations [MINOR] update known_translations 2018-11-06 14:52:02 -08:00
release-build.sh [SPARK-30268][INFRA] Fix incorrect pyspark version when releasing preview versions 2019-12-17 10:22:29 +09:00
release-tag.sh [SPARK-30265][INFRA] Do not change R version when releasing preview versions 2019-12-16 04:54:12 -07:00
release-util.sh [SPARK-28511][INFRA] Get REV from RELEASE_VERSION instead of VERSION 2019-07-25 10:54:24 -07:00
releaseutils.py [MINOR][BUILD] ensure call to translate_component has correct number of arguments 2019-01-16 21:00:58 -06:00
translate-contributors.py [SPARK-19002][BUILD][PYTHON] Check pep8 against all Python scripts 2017-01-02 15:23:19 +00:00
vote.tmpl [MINOR][DOCS] Tighten up some key links to the project and download pages to use HTTPS 2019-05-21 10:56:42 -07:00