spark-instrumented-optimizer/.github/workflows
Hyukjin Kwon 7d371d27f2 [SPARK-35393][PYTHON][INFRA][TESTS] Recover pip packaging test in Github Actions
### What changes were proposed in this pull request?

Currently pip packaging test is being skipped:

```
========================================================================
Running PySpark packaging tests
========================================================================
Constructing virtual env for testing
Missing virtualenv & conda, skipping pip installability tests
Cleaning up temporary directory - /tmp/tmp.iILYWISPXW
```

See https://github.com/apache/spark/runs/2568923639?check_suite_focus=true

GitHub Actions's image has its default Conda installed at `/usr/share/miniconda` but seems like the image we're using for PySpark does not have it (which is legitimate).

This PR proposes to install Conda to use in pip packaging tests in GitHub Actions.

### Why are the changes needed?

To recover the test coverage.

### Does this PR introduce _any_ user-facing change?

No, dev-only.

### How was this patch tested?

It was tested in my fork: https://github.com/HyukjinKwon/spark/runs/2575126882?check_suite_focus=true

```
========================================================================
Running PySpark packaging tests
========================================================================
Constructing virtual env for testing
Using conda virtual environments
Testing pip installation with python 3.6
Using /tmp/tmp.qPjTenqfGn for virtualenv
Collecting package metadata (current_repodata.json): ...working... done
Solving environment: ...working... failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... done

## Package Plan ##

  environment location: /tmp/tmp.qPjTenqfGn/3.6

  added / updated specs:
    - numpy
    - pandas
    - pip
    - python=3.6
    - setuptools

...

Successfully ran pip sanity check
```

Closes #32537 from HyukjinKwon/SPARK-35393.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
2021-05-13 10:35:56 -07:00
..
benchmark.yml [SPARK-35302][INFRA] Benchmark workflow should create new files for new benchmarks 2021-05-04 19:02:52 +09:00
build_and_test.yml [SPARK-35393][PYTHON][INFRA][TESTS] Recover pip packaging test in Github Actions 2021-05-13 10:35:56 -07:00
cancel_duplicate_workflow_runs.yml [SPARK-34053][INFRA][FOLLOW-UP] Disables canceling push/schedule workflows 2021-01-12 23:10:20 +09:00
labeler.yml [SPARK-35101][INFRA] Add GitHub status check in PR instead of a comment 2021-04-18 11:33:42 +09:00
notify_test_workflow.yml [SPARK-35120][INFRA][FOLLOW-UP] Try catch an error to show the correct guidance 2021-04-21 13:32:04 +08:00
publish_snapshot.yml [BUILD][MINOR] Do not publish snapshots from forks 2020-12-23 00:22:42 +09:00
stale.yml [SPARK-30173] Tweak stale PR message 2020-01-07 08:34:59 -06:00
test_report.yml [SPARK-34874][INFRA] Recover test reports for failed GA builds 2021-03-26 18:12:28 +09:00
update_build_status.yml [SPARK-35120][INFRA] Guide users to sync branch and enable GitHub Actions in their forked repository 2021-04-19 10:40:50 -07:00