ebf01ec3c1
### What changes were proposed in this pull request? https://github.com/apache/spark/pull/32015 added a way to run benchmarks much more easily in the same GitHub Actions build. This PR updates the benchmark results by using the way. **NOTE** that looks like GitHub Actions use four types of CPU given my observations: - Intel(R) Xeon(R) Platinum 8171M CPU 2.60GHz - Intel(R) Xeon(R) CPU E5-2673 v4 2.30GHz - Intel(R) Xeon(R) CPU E5-2673 v3 2.40GHz - Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz Given my quick research, seems like they perform roughly similarly:  I couldn't find enough information about Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz but the performance seems roughly similar given the numbers. So shouldn't be a big deal especially given that this way is much easier, encourages contributors to run more and guarantee the same number of cores and same memory with the same softwares. ### Why are the changes needed? To have a base line of the benchmarks accordingly. ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? It was generated from: - [Run benchmarks: * (JDK 11)](https://github.com/HyukjinKwon/spark/actions/runs/713575465) - [Run benchmarks: * (JDK 8)](https://github.com/HyukjinKwon/spark/actions/runs/713154337) Closes #32044 from HyukjinKwon/SPARK-34950. Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by: Max Gekk <max.gekk@gmail.com>
46 lines
3.5 KiB
Plaintext
46 lines
3.5 KiB
Plaintext
================================================================================================
|
|
Hive UDAF vs Spark AF
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
|
|
hive udaf vs spark af: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
hive udaf w/o group by 4805 4881 55 0.0 73323.1 1.0X
|
|
spark af w/o group by 34 39 6 2.0 511.6 143.3X
|
|
hive udaf w/ group by 3770 3884 202 0.0 57526.2 1.3X
|
|
spark af w/ group by w/o fallback 34 39 5 1.9 525.7 139.5X
|
|
spark af w/ group by w/ fallback 39 44 5 1.7 596.5 122.9X
|
|
|
|
|
|
================================================================================================
|
|
ObjectHashAggregateExec vs SortAggregateExec - typed_count
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
|
|
object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
sort agg w/ group by 30645 31295 919 3.4 292.3 1.0X
|
|
object agg w/ group by w/o fallback 7025 7425 425 14.9 67.0 4.4X
|
|
object agg w/ group by w/ fallback 17222 18169 1251 6.1 164.2 1.8X
|
|
sort agg w/o group by 4755 4827 143 22.1 45.3 6.4X
|
|
object agg w/o group by w/o fallback 4183 4495 269 25.1 39.9 7.3X
|
|
|
|
|
|
================================================================================================
|
|
ObjectHashAggregateExec vs SortAggregateExec - percentile_approx
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
|
|
object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
sort agg w/ group by 625 673 29 3.4 297.9 1.0X
|
|
object agg w/ group by w/o fallback 509 549 24 4.1 242.9 1.2X
|
|
object agg w/ group by w/ fallback 600 652 33 3.5 286.2 1.0X
|
|
sort agg w/o group by 461 499 20 4.6 219.6 1.4X
|
|
object agg w/o group by w/o fallback 470 510 22 4.5 224.0 1.3X
|
|
|
|
|