310cd8eef1
This PR proposes to migrate Coverage report from Jenkins to GitHub Actions by setting a dailly cron job. For some background, currently PySpark code coverage is being reported in this specific Jenkins job: https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7/ Because of the security issue between [Codecov service](https://app.codecov.io/gh/) and Jenkins machines, we had to work around by manually hosting a coverage site via GitHub pages, see also https://spark-test.github.io/pyspark-coverage-site/ by spark-test account (which is shared to only subset of PMC members). Since we now run the build via GitHub Actions, we can leverage [Codecov plugin](https://github.com/codecov/codecov-action), and remove the workaround we used. Virtually no. Coverage site (UI) might change but the information it holds should be virtually the same. I manually tested: - Scheduled run: https://github.com/HyukjinKwon/spark/actions/runs/1082261484 - Coverage report:73f0291a7d/python/pyspark- Run against a PR: https://github.com/HyukjinKwon/spark/actions/runs/1082367175 Closes #33591 from HyukjinKwon/SPARK-36092. Authored-by: Hyukjin Kwon <gurwls223@apache.org> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org> (cherry picked from commitc0d1860f25) Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
114 lines
1.8 KiB
Plaintext
114 lines
1.8 KiB
Plaintext
*#*#
|
|
*.#*
|
|
*.iml
|
|
*.ipr
|
|
*.iws
|
|
*.pyc
|
|
*.pyo
|
|
*.swp
|
|
*~
|
|
.DS_Store
|
|
.bsp/
|
|
.cache
|
|
.classpath
|
|
.ensime
|
|
.ensime_cache/
|
|
.ensime_lucene
|
|
.generated-mima*
|
|
# All the files under .idea/ are ignore. To add new files under ./idea that are not in the VCS yet, please use `git add -f`
|
|
.idea/
|
|
# SPARK-35223: Add IssueNavigationLink to make IDEA support hyperlink on JIRA Ticket and GitHub PR on Git plugin.
|
|
!.idea/vcs.xml
|
|
.idea_modules/
|
|
.project
|
|
.pydevproject
|
|
.scala_dependencies
|
|
.settings
|
|
/lib/
|
|
R-unit-tests.log
|
|
R/unit-tests.out
|
|
R/cran-check.out
|
|
R/pkg/vignettes/sparkr-vignettes.html
|
|
R/pkg/tests/fulltests/Rplots.pdf
|
|
build/*.jar
|
|
build/apache-maven*
|
|
build/scala*
|
|
cache
|
|
checkpoint
|
|
conf/*.cmd
|
|
conf/*.conf
|
|
conf/*.properties
|
|
conf/*.sh
|
|
conf/*.xml
|
|
conf/java-opts
|
|
conf/slaves
|
|
dependency-reduced-pom.xml
|
|
derby.log
|
|
dev/create-release/*final
|
|
dev/create-release/*txt
|
|
dev/pr-deps/
|
|
dist/
|
|
docs/_site/
|
|
docs/api
|
|
docs/.local_ruby_bundle
|
|
sql/docs
|
|
sql/site
|
|
lib_managed/
|
|
lint-r-report.log
|
|
lint-js-report.log
|
|
log/
|
|
logs/
|
|
out/
|
|
project/boot/
|
|
project/build/target/
|
|
project/plugins/lib_managed/
|
|
project/plugins/project/build.properties
|
|
project/plugins/src_managed/
|
|
project/plugins/target/
|
|
python/lib/pyspark.zip
|
|
python/.eggs/
|
|
python/coverage.xml
|
|
python/deps
|
|
python/docs/_site/
|
|
python/docs/source/reference/**/api/
|
|
python/test_coverage/coverage_data
|
|
python/test_coverage/htmlcov
|
|
python/pyspark/python
|
|
.mypy_cache/
|
|
reports/
|
|
scalastyle-on-compile.generated.xml
|
|
scalastyle-output.xml
|
|
scalastyle.txt
|
|
spark-*-bin-*.tgz
|
|
spark-tests.log
|
|
src_managed/
|
|
streaming-tests.log
|
|
target/
|
|
unit-tests.log
|
|
work/
|
|
docs/.jekyll-metadata
|
|
docs/.jekyll-cache
|
|
|
|
# For Hive
|
|
TempStatsStore/
|
|
metastore/
|
|
metastore_db/
|
|
sql/hive-thriftserver/test_warehouses
|
|
warehouse/
|
|
spark-warehouse/
|
|
|
|
# For R session data
|
|
.RData
|
|
.RHistory
|
|
.Rhistory
|
|
*.Rproj
|
|
*.Rproj.*
|
|
|
|
.Rproj.user
|
|
|
|
# For SBT
|
|
.jvmopts
|
|
|
|
# For Node.js
|
|
node_modules
|