ebf01ec3c1
### What changes were proposed in this pull request? https://github.com/apache/spark/pull/32015 added a way to run benchmarks much more easily in the same GitHub Actions build. This PR updates the benchmark results by using the way. **NOTE** that looks like GitHub Actions use four types of CPU given my observations: - Intel(R) Xeon(R) Platinum 8171M CPU 2.60GHz - Intel(R) Xeon(R) CPU E5-2673 v4 2.30GHz - Intel(R) Xeon(R) CPU E5-2673 v3 2.40GHz - Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz Given my quick research, seems like they perform roughly similarly:  I couldn't find enough information about Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz but the performance seems roughly similar given the numbers. So shouldn't be a big deal especially given that this way is much easier, encourages contributors to run more and guarantee the same number of cores and same memory with the same softwares. ### Why are the changes needed? To have a base line of the benchmarks accordingly. ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? It was generated from: - [Run benchmarks: * (JDK 11)](https://github.com/HyukjinKwon/spark/actions/runs/713575465) - [Run benchmarks: * (JDK 8)](https://github.com/HyukjinKwon/spark/actions/runs/713154337) Closes #32044 from HyukjinKwon/SPARK-34950. Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by: Max Gekk <max.gekk@gmail.com>
60 lines
4.4 KiB
Plaintext
60 lines
4.4 KiB
Plaintext
================================================================================================
|
|
Int Read/Write
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
Int Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
Java Array 274 279 5 1196.8 0.8 1.0X
|
|
ByteBuffer Unsafe 476 487 6 687.7 1.5 0.6X
|
|
ByteBuffer API 2024 2030 8 161.9 6.2 0.1X
|
|
DirectByteBuffer 702 755 47 466.8 2.1 0.4X
|
|
Unsafe Buffer 250 266 13 1311.9 0.8 1.1X
|
|
Column(on heap) 260 272 7 1258.0 0.8 1.1X
|
|
Column(off heap) 528 540 13 620.1 1.6 0.5X
|
|
Column(off heap direct) 265 272 6 1236.9 0.8 1.0X
|
|
UnsafeRow (on heap) 551 556 4 594.8 1.7 0.5X
|
|
UnsafeRow (off heap) 565 586 19 579.9 1.7 0.5X
|
|
Column On Heap Append 544 552 10 602.1 1.7 0.5X
|
|
|
|
|
|
================================================================================================
|
|
Boolean Read/Write
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
Boolean Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
Bitset 1009 1026 25 332.6 3.0 1.0X
|
|
Byte Array 756 768 11 443.7 2.3 1.3X
|
|
|
|
|
|
================================================================================================
|
|
String Read/Write
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
String Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
On Heap 396 408 9 41.3 24.2 1.0X
|
|
Off Heap 673 696 20 24.3 41.1 0.6X
|
|
|
|
|
|
================================================================================================
|
|
Array Vector Read
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
Array Vector Read: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
On Heap Read Size Only 458 486 16 357.6 2.8 1.0X
|
|
Off Heap Read Size Only 260 275 9 630.6 1.6 1.8X
|
|
On Heap Read Elements 3315 3349 48 49.4 20.2 0.1X
|
|
Off Heap Read Elements 5265 5304 55 31.1 32.1 0.1X
|
|
|
|
|