spark-instrumented-optimizer/sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt
HyukjinKwon ebf01ec3c1 [SPARK-34950][TESTS] Update benchmark results to the ones created by GitHub Actions machines
### What changes were proposed in this pull request?

https://github.com/apache/spark/pull/32015 added a way to run benchmarks much more easily in the same GitHub Actions build. This PR updates the benchmark results by using the way.

**NOTE** that looks like GitHub Actions use four types of CPU given my observations:

- Intel(R) Xeon(R) Platinum 8171M CPU  2.60GHz
- Intel(R) Xeon(R) CPU E5-2673 v4  2.30GHz
- Intel(R) Xeon(R) CPU E5-2673 v3  2.40GHz
- Intel(R) Xeon(R) Platinum 8272CL CPU  2.60GHz

Given my quick research, seems like they perform roughly similarly:

![Screen Shot 2021-04-03 at 9 31 23 PM](https://user-images.githubusercontent.com/6477701/113478478-f4b57b80-94c3-11eb-9047-f81ca8c59672.png)

I couldn't find enough information about Intel(R) Xeon(R) Platinum 8272CL CPU  2.60GHz but the performance seems roughly similar given the numbers.

So shouldn't be a big deal especially given that this way is much easier, encourages contributors to run more and guarantee the same number of cores and same memory with the same softwares.

### Why are the changes needed?

To have a base line of the benchmarks accordingly.

### Does this PR introduce _any_ user-facing change?

No, dev-only.

### How was this patch tested?

It was generated from:

- [Run benchmarks: * (JDK 11)](https://github.com/HyukjinKwon/spark/actions/runs/713575465)
- [Run benchmarks: * (JDK 8)](https://github.com/HyukjinKwon/spark/actions/runs/713154337)

Closes #32044 from HyukjinKwon/SPARK-34950.

Authored-by: HyukjinKwon <gurwls223@apache.org>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
2021-04-03 23:02:56 +03:00

60 lines
4.4 KiB
Plaintext

================================================================================================
Int Read/Write
================================================================================================
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Int Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Java Array 263 266 3 1247.5 0.8 1.0X
ByteBuffer Unsafe 1039 1050 15 315.3 3.2 0.3X
ByteBuffer API 923 928 8 355.0 2.8 0.3X
DirectByteBuffer 1370 1371 1 239.1 4.2 0.2X
Unsafe Buffer 350 357 6 937.5 1.1 0.8X
Column(on heap) 265 269 3 1235.8 0.8 1.0X
Column(off heap) 514 519 3 637.2 1.6 0.5X
Column(off heap direct) 348 354 5 940.8 1.1 0.8X
UnsafeRow (on heap) 800 819 23 409.6 2.4 0.3X
UnsafeRow (off heap) 755 760 5 433.9 2.3 0.3X
Column On Heap Append 520 529 9 629.8 1.6 0.5X
================================================================================================
Boolean Read/Write
================================================================================================
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Boolean Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Bitset 846 848 1 396.4 2.5 1.0X
Byte Array 386 391 4 869.5 1.2 2.2X
================================================================================================
String Read/Write
================================================================================================
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
String Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
On Heap 536 538 1 30.5 32.7 1.0X
Off Heap 751 759 7 21.8 45.8 0.7X
================================================================================================
Array Vector Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Array Vector Read: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
On Heap Read Size Only 96 100 2 1698.7 0.6 1.0X
Off Heap Read Size Only 356 364 9 459.6 2.2 0.3X
On Heap Read Elements 4971 4972 2 33.0 30.3 0.0X
Off Heap Read Elements 6833 6880 67 24.0 41.7 0.0X