ebf01ec3c1
### What changes were proposed in this pull request? https://github.com/apache/spark/pull/32015 added a way to run benchmarks much more easily in the same GitHub Actions build. This PR updates the benchmark results by using the way. **NOTE** that looks like GitHub Actions use four types of CPU given my observations: - Intel(R) Xeon(R) Platinum 8171M CPU 2.60GHz - Intel(R) Xeon(R) CPU E5-2673 v4 2.30GHz - Intel(R) Xeon(R) CPU E5-2673 v3 2.40GHz - Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz Given my quick research, seems like they perform roughly similarly: ![Screen Shot 2021-04-03 at 9 31 23 PM](https://user-images.githubusercontent.com/6477701/113478478-f4b57b80-94c3-11eb-9047-f81ca8c59672.png) I couldn't find enough information about Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz but the performance seems roughly similar given the numbers. So shouldn't be a big deal especially given that this way is much easier, encourages contributors to run more and guarantee the same number of cores and same memory with the same softwares. ### Why are the changes needed? To have a base line of the benchmarks accordingly. ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? It was generated from: - [Run benchmarks: * (JDK 11)](https://github.com/HyukjinKwon/spark/actions/runs/713575465) - [Run benchmarks: * (JDK 8)](https://github.com/HyukjinKwon/spark/actions/runs/713154337) Closes #32044 from HyukjinKwon/SPARK-34950. Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by: Max Gekk <max.gekk@gmail.com>
128 lines
9.1 KiB
Plaintext
128 lines
9.1 KiB
Plaintext
================================================================================================
|
|
filter & aggregate without group
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
range/filter/sum wholestage off 98011 99011 1415 21.4 46.7 1.0X
|
|
range/filter/sum wholestage on 3287 3614 183 638.1 1.6 29.8X
|
|
|
|
|
|
================================================================================================
|
|
range/limit/sum
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
range/limit/sum wholestage off 93 96 4 5625.2 0.2 1.0X
|
|
range/limit/sum wholestage on 42 49 9 12366.6 0.1 2.2X
|
|
|
|
|
|
================================================================================================
|
|
sample
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
sample with replacement wholestage off 13712 13721 13 9.6 104.6 1.0X
|
|
sample with replacement wholestage on 7532 7561 47 17.4 57.5 1.8X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
-------------------------------------------------------------------------------------------------------------------------
|
|
sample without replacement wholestage off 4652 4652 1 28.2 35.5 1.0X
|
|
sample without replacement wholestage on 1065 1096 56 123.1 8.1 4.4X
|
|
|
|
|
|
================================================================================================
|
|
collect
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
collect 1 million 249 253 3 4.2 237.8 1.0X
|
|
collect 2 millions 482 500 28 2.2 459.2 0.5X
|
|
collect 4 millions 989 1016 38 1.1 943.5 0.3X
|
|
|
|
|
|
================================================================================================
|
|
collect limit
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
collect limit 1 million 297 303 4 3.5 283.5 1.0X
|
|
collect limit 2 millions 582 593 14 1.8 554.6 0.5X
|
|
|
|
|
|
================================================================================================
|
|
generate explode
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
generate explode array wholestage off 17458 17507 70 1.0 1040.6 1.0X
|
|
generate explode array wholestage on 6094 6178 93 2.8 363.2 2.9X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
generate explode map wholestage off 51077 53221 3032 0.3 3044.4 1.0X
|
|
generate explode map wholestage on 30130 30343 200 0.6 1795.9 1.7X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
generate posexplode array wholestage off 18582 18702 170 0.9 1107.6 1.0X
|
|
generate posexplode array wholestage on 6164 6208 32 2.7 367.4 3.0X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
generate inline array wholestage off 13275 14431 1635 1.3 791.2 1.0X
|
|
generate inline array wholestage on 4668 4752 118 3.6 278.3 2.8X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
generate big struct array wholestage off 382 385 4 0.2 6367.5 1.0X
|
|
generate big struct array wholestage on 327 349 42 0.2 5446.1 1.2X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
-------------------------------------------------------------------------------------------------------------------------------
|
|
generate big nested struct array wholestage off 45694 45856 229 0.0 761565.1 1.0X
|
|
generate big nested struct array wholestage on 338 356 35 0.2 5631.4 135.2X
|
|
|
|
|
|
================================================================================================
|
|
generate regular generator
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
|
|
generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
generate stack wholestage off 26624 26685 87 0.6 1586.9 1.0X
|
|
generate stack wholestage on 5948 5971 25 2.8 354.5 4.5X
|
|
|
|
|