f642234d85
### What changes were proposed in this pull request? This PR aims to speed up `MapStatus` deserialization by 5~18% with the latest RoaringBitmap `0.9.0` and new APIs. Note that we focus on `deserialization` time because `serialization` occurs once while `deserialization` occurs many times. ### Why are the changes needed? The current version is too old. We had better upgrade it to get the performance improvement and bug fixes. Although `MapStatusesSerDeserBenchmark` is synthetic, the benchmark result is updated with this patch. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the Jenkins or GitHub Action. Closes #29233 from dongjoon-hyun/SPARK-ROAR. Authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org> |
||
---|---|---|
.. | ||
CoalescedRDDBenchmark-jdk11-results.txt | ||
CoalescedRDDBenchmark-results.txt | ||
KryoBenchmark-jdk11-results.txt | ||
KryoBenchmark-results.txt | ||
KryoSerializerBenchmark-jdk11-results.txt | ||
KryoSerializerBenchmark-results.txt | ||
MapStatusesSerDeserBenchmark-jdk11-results.txt | ||
MapStatusesSerDeserBenchmark-results.txt | ||
PropertiesCloneBenchmark-jdk11-results.txt | ||
PropertiesCloneBenchmark-results.txt | ||
XORShiftRandomBenchmark-jdk11-results.txt | ||
XORShiftRandomBenchmark-results.txt |