2d47fb7683
### What changes were proposed in this pull request? This PR proposes to use higher versions of PyArrow which more users use in general. Without this PR, the testing matrix as follows: - (Python 3.8) Use PyArrow **2.x** in [pandas UDF tests in SQL side](https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/IntegratedUDFTestUtils.scala) - (Python 3.6) Use PyArrow **2.x** in PySpark tests - (Python 3.9) Use PyArrow 4.x in PySpark tests (no change) - (Python 3.6) Use PyArrow **2.x** in PySpark documentation generation (it runs Spark jobs to generate images to use in PySpark API docs) After this PR, the testing matrix as follows: - (Python 3.8) Use PyArrow **4.x** in [pandas UDF tests in SQL side](https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/IntegratedUDFTestUtils.scala) - (Python 3.6) Use PyArrow **3.x** in PySpark tests - (Python 3.9) Use PyArrow 4.x in PySpark tests (no change) - (Python 3.6) Use PyArrow **4.x** in PySpark documentation generation (it runs Spark jobs to generate images to use in PySpark API docs) ### Why are the changes needed? Test matrix which more people use. ### Does this PR introduce _any_ user-facing change? No, dev and testing only. ### How was this patch tested? GitHub Actions in this PR should test it out. Closes #32906 from HyukjinKwon/SPARK-35755. Authored-by: Hyukjin Kwon <gurwls223@apache.org> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org> |
||
|---|---|---|
| .. | ||
| workflows | ||
| labeler.yml | ||
| PULL_REQUEST_TEMPLATE | ||