spark-instrumented-optimizer/sql/core/benchmarks/IntervalBenchmark-results.txt
HyukjinKwon ebf01ec3c1 [SPARK-34950][TESTS] Update benchmark results to the ones created by GitHub Actions machines
### What changes were proposed in this pull request?

https://github.com/apache/spark/pull/32015 added a way to run benchmarks much more easily in the same GitHub Actions build. This PR updates the benchmark results by using the way.

**NOTE** that looks like GitHub Actions use four types of CPU given my observations:

- Intel(R) Xeon(R) Platinum 8171M CPU  2.60GHz
- Intel(R) Xeon(R) CPU E5-2673 v4  2.30GHz
- Intel(R) Xeon(R) CPU E5-2673 v3  2.40GHz
- Intel(R) Xeon(R) Platinum 8272CL CPU  2.60GHz

Given my quick research, seems like they perform roughly similarly:

![Screen Shot 2021-04-03 at 9 31 23 PM](https://user-images.githubusercontent.com/6477701/113478478-f4b57b80-94c3-11eb-9047-f81ca8c59672.png)

I couldn't find enough information about Intel(R) Xeon(R) Platinum 8272CL CPU  2.60GHz but the performance seems roughly similar given the numbers.

So shouldn't be a big deal especially given that this way is much easier, encourages contributors to run more and guarantee the same number of cores and same memory with the same softwares.

### Why are the changes needed?

To have a base line of the benchmarks accordingly.

### Does this PR introduce _any_ user-facing change?

No, dev-only.

### How was this patch tested?

It was generated from:

- [Run benchmarks: * (JDK 11)](https://github.com/HyukjinKwon/spark/actions/runs/713575465)
- [Run benchmarks: * (JDK 8)](https://github.com/HyukjinKwon/spark/actions/runs/713154337)

Closes #32044 from HyukjinKwon/SPARK-34950.

Authored-by: HyukjinKwon <gurwls223@apache.org>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
2021-04-03 23:02:56 +03:00

41 lines
4.2 KiB
Plaintext

OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
cast strings to intervals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
prepare string w/ interval 638 642 4 1.6 637.6 1.0X
prepare string w/o interval 637 640 5 1.6 636.6 1.0X
1 units w/ interval 652 673 18 1.5 652.4 1.0X
1 units w/o interval 610 624 12 1.6 610.4 1.0X
2 units w/ interval 795 800 7 1.3 794.9 0.8X
2 units w/o interval 773 812 35 1.3 773.3 0.8X
3 units w/ interval 1713 1756 38 0.6 1713.3 0.4X
3 units w/o interval 1714 1747 37 0.6 1714.3 0.4X
4 units w/ interval 1945 1980 50 0.5 1944.9 0.3X
4 units w/o interval 1923 1986 55 0.5 1922.8 0.3X
5 units w/ interval 2138 2184 42 0.5 2138.4 0.3X
5 units w/o interval 2149 2174 35 0.5 2148.5 0.3X
6 units w/ interval 2383 2418 33 0.4 2383.0 0.3X
6 units w/o interval 2413 2432 23 0.4 2412.9 0.3X
7 units w/ interval 2976 3005 25 0.3 2976.1 0.2X
7 units w/o interval 2955 2995 56 0.3 2954.9 0.2X
8 units w/ interval 3256 3303 42 0.3 3256.1 0.2X
8 units w/o interval 3264 3320 49 0.3 3263.9 0.2X
9 units w/ interval 3587 3616 27 0.3 3587.0 0.2X
9 units w/o interval 3613 3681 82 0.3 3613.5 0.2X
10 units w/ interval 3972 3994 19 0.3 3972.4 0.2X
10 units w/o interval 3934 3984 48 0.3 3933.7 0.2X
11 units w/ interval 4226 4233 6 0.2 4226.1 0.2X
11 units w/o interval 4172 4222 64 0.2 4171.9 0.2X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
make_interval(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
prepare make_interval() 4533 4626 91 0.2 4532.8 1.0X
make_interval(0, 1, 2, 3, 4, 5, 50.123456) 68 68 0 14.7 67.9 66.7X
make_interval(*, *, 2, 3, 4, 5, 50.123456) 92 98 6 10.8 92.3 49.1X
make_interval(0, 1, *, *, 4, 5, 50.123456) 103 107 6 9.7 102.8 44.1X
make_interval(0, 1, 2, 3, *, *, *) 4521 4576 47 0.2 4521.4 1.0X
make_interval(*, *, *, *, *, *, *) 4580 4591 11 0.2 4579.9 1.0X