a82aee0441
### What changes were proposed in this pull request? This PR removes the manual port of `heapq3.py` introduced from SPARK-3073. The main reason of this was to support Python 2.6 and 2.7 because Python 2's `heapq.merge()` doesn't not support `key` and `reverse`. See - https://docs.python.org/2/library/heapq.html#heapq.merge in Python 2 - https://docs.python.org/3.8/library/heapq.html#heapq.merge in Python 3 Since we dropped the Python 2 at SPARK-32138, we can remove this away. ### Why are the changes needed? To remove unnecessary codes. Also, we can leverage bug fixes made in Python 3.x at `heapq`. ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? Existing tests should cover. I locally ran and verified: ```bash ./python/run-tests --python-executable=python3 --testname="pyspark.tests.test_shuffle" ./python/run-tests --python-executable=python3 --testname="pyspark.shuffle ExternalSorter" ./python/run-tests --python-executable=python3 --testname="pyspark.tests.test_rdd RDDTests.test_external_group_by_key" ``` Closes #29229 from HyukjinKwon/SPARK-32435. Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by: HyukjinKwon <gurwls223@apache.org> |
||
---|---|---|
.. | ||
LICENSE-AnchorJS.txt | ||
LICENSE-bootstrap.txt | ||
LICENSE-CC0.txt | ||
LICENSE-cloudpickle.txt | ||
LICENSE-copybutton.txt | ||
LICENSE-d3.min.js.txt | ||
LICENSE-dagre-d3.txt | ||
LICENSE-datatables.txt | ||
LICENSE-graphlib-dot.txt | ||
LICENSE-join.txt | ||
LICENSE-jquery.txt | ||
LICENSE-json-formatter.txt | ||
LICENSE-matchMedia-polyfill.txt | ||
LICENSE-modernizr.txt | ||
LICENSE-mustache.txt | ||
LICENSE-py4j.txt | ||
LICENSE-respond.txt | ||
LICENSE-sbt-launch-lib.txt | ||
LICENSE-sorttable.js.txt | ||
LICENSE-vis-timeline.txt |