ebf01ec3c1
### What changes were proposed in this pull request? https://github.com/apache/spark/pull/32015 added a way to run benchmarks much more easily in the same GitHub Actions build. This PR updates the benchmark results by using the way. **NOTE** that looks like GitHub Actions use four types of CPU given my observations: - Intel(R) Xeon(R) Platinum 8171M CPU 2.60GHz - Intel(R) Xeon(R) CPU E5-2673 v4 2.30GHz - Intel(R) Xeon(R) CPU E5-2673 v3 2.40GHz - Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz Given my quick research, seems like they perform roughly similarly: ![Screen Shot 2021-04-03 at 9 31 23 PM](https://user-images.githubusercontent.com/6477701/113478478-f4b57b80-94c3-11eb-9047-f81ca8c59672.png) I couldn't find enough information about Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz but the performance seems roughly similar given the numbers. So shouldn't be a big deal especially given that this way is much easier, encourages contributors to run more and guarantee the same number of cores and same memory with the same softwares. ### Why are the changes needed? To have a base line of the benchmarks accordingly. ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? It was generated from: - [Run benchmarks: * (JDK 11)](https://github.com/HyukjinKwon/spark/actions/runs/713575465) - [Run benchmarks: * (JDK 8)](https://github.com/HyukjinKwon/spark/actions/runs/713154337) Closes #32044 from HyukjinKwon/SPARK-34950. Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by: Max Gekk <max.gekk@gmail.com>
28 lines
2.6 KiB
Plaintext
28 lines
2.6 KiB
Plaintext
================================================================================================
|
|
Benchmark ZStandardCompressionCodec
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
|
|
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
--------------------------------------------------------------------------------------------------------------------------------------
|
|
Compression 10000 times at level 1 without buffer pool 606 614 6 0.0 60645.3 1.0X
|
|
Compression 10000 times at level 2 without buffer pool 686 693 7 0.0 68594.9 0.9X
|
|
Compression 10000 times at level 3 without buffer pool 906 920 14 0.0 90642.7 0.7X
|
|
Compression 10000 times at level 1 with buffer pool 389 403 20 0.0 38901.4 1.6X
|
|
Compression 10000 times at level 2 with buffer pool 450 466 13 0.0 45032.0 1.3X
|
|
Compression 10000 times at level 3 with buffer pool 680 682 2 0.0 68004.2 0.9X
|
|
|
|
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
|
|
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------------------------
|
|
Decompression 10000 times from level 1 without buffer pool 1209 1226 25 0.0 120862.8 1.0X
|
|
Decompression 10000 times from level 2 without buffer pool 1191 1193 3 0.0 119064.9 1.0X
|
|
Decompression 10000 times from level 3 without buffer pool 1188 1193 6 0.0 118843.3 1.0X
|
|
Decompression 10000 times from level 1 with buffer pool 998 1004 9 0.0 99754.7 1.2X
|
|
Decompression 10000 times from level 2 with buffer pool 990 1001 11 0.0 99043.8 1.2X
|
|
Decompression 10000 times from level 3 with buffer pool 983 999 20 0.0 98269.5 1.2X
|
|
|
|
|