a82aee0441
### What changes were proposed in this pull request? This PR removes the manual port of `heapq3.py` introduced from SPARK-3073. The main reason of this was to support Python 2.6 and 2.7 because Python 2's `heapq.merge()` doesn't not support `key` and `reverse`. See - https://docs.python.org/2/library/heapq.html#heapq.merge in Python 2 - https://docs.python.org/3.8/library/heapq.html#heapq.merge in Python 3 Since we dropped the Python 2 at SPARK-32138, we can remove this away. ### Why are the changes needed? To remove unnecessary codes. Also, we can leverage bug fixes made in Python 3.x at `heapq`. ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? Existing tests should cover. I locally ran and verified: ```bash ./python/run-tests --python-executable=python3 --testname="pyspark.tests.test_shuffle" ./python/run-tests --python-executable=python3 --testname="pyspark.shuffle ExternalSorter" ./python/run-tests --python-executable=python3 --testname="pyspark.tests.test_rdd RDDTests.test_external_group_by_key" ``` Closes #29229 from HyukjinKwon/SPARK-32435. Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by: HyukjinKwon <gurwls223@apache.org> |
||
---|---|---|
.. | ||
LICENSE-AnchorJS.txt | ||
LICENSE-antlr.txt | ||
LICENSE-arpack.txt | ||
LICENSE-automaton.txt | ||
LICENSE-bootstrap.txt | ||
LICENSE-CC0.txt | ||
LICENSE-cloudpickle.txt | ||
LICENSE-d3.min.js.txt | ||
LICENSE-dagre-d3.txt | ||
LICENSE-datatables.txt | ||
LICENSE-dnsjava.txt | ||
LICENSE-f2j.txt | ||
LICENSE-graphlib-dot.txt | ||
LICENSE-istack-commons-runtime.txt | ||
LICENSE-jakarta-annotation-api | ||
LICENSE-jakarta-ws-rs-api | ||
LICENSE-jakarta.activation-api.txt | ||
LICENSE-jakarta.xml.bind-api.txt | ||
LICENSE-janino.txt | ||
LICENSE-javassist.html | ||
LICENSE-javax-transaction-transaction-api.txt | ||
LICENSE-javolution.txt | ||
LICENSE-jaxb-runtime.txt | ||
LICENSE-JLargeArrays.txt | ||
LICENSE-jline.txt | ||
LICENSE-jodd.txt | ||
LICENSE-join.txt | ||
LICENSE-jquery.txt | ||
LICENSE-json-formatter.txt | ||
LICENSE-jsp-api.txt | ||
LICENSE-JTransforms.txt | ||
LICENSE-kryo.txt | ||
LICENSE-leveldbjni.txt | ||
LICENSE-machinist.txt | ||
LICENSE-matchMedia-polyfill.txt | ||
LICENSE-minlog.txt | ||
LICENSE-modernizr.txt | ||
LICENSE-mustache.txt | ||
LICENSE-netlib.txt | ||
LICENSE-paranamer.txt | ||
LICENSE-pmml-model.txt | ||
LICENSE-protobuf.txt | ||
LICENSE-py4j.txt | ||
LICENSE-pyrolite.txt | ||
LICENSE-re2j.txt | ||
LICENSE-reflectasm.txt | ||
LICENSE-respond.txt | ||
LICENSE-sbt-launch-lib.txt | ||
LICENSE-scala.txt | ||
LICENSE-scopt.txt | ||
LICENSE-slf4j.txt | ||
LICENSE-sorttable.js.txt | ||
LICENSE-spire.txt | ||
LICENSE-vis-timeline.txt | ||
LICENSE-xmlenc.txt | ||
LICENSE-zstd-jni.txt | ||
LICENSE-zstd.txt |