ebf01ec3c1
### What changes were proposed in this pull request? https://github.com/apache/spark/pull/32015 added a way to run benchmarks much more easily in the same GitHub Actions build. This PR updates the benchmark results by using the way. **NOTE** that looks like GitHub Actions use four types of CPU given my observations: - Intel(R) Xeon(R) Platinum 8171M CPU 2.60GHz - Intel(R) Xeon(R) CPU E5-2673 v4 2.30GHz - Intel(R) Xeon(R) CPU E5-2673 v3 2.40GHz - Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz Given my quick research, seems like they perform roughly similarly: ![Screen Shot 2021-04-03 at 9 31 23 PM](https://user-images.githubusercontent.com/6477701/113478478-f4b57b80-94c3-11eb-9047-f81ca8c59672.png) I couldn't find enough information about Intel(R) Xeon(R) Platinum 8272CL CPU 2.60GHz but the performance seems roughly similar given the numbers. So shouldn't be a big deal especially given that this way is much easier, encourages contributors to run more and guarantee the same number of cores and same memory with the same softwares. ### Why are the changes needed? To have a base line of the benchmarks accordingly. ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? It was generated from: - [Run benchmarks: * (JDK 11)](https://github.com/HyukjinKwon/spark/actions/runs/713575465) - [Run benchmarks: * (JDK 8)](https://github.com/HyukjinKwon/spark/actions/runs/713154337) Closes #32044 from HyukjinKwon/SPARK-34950. Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by: Max Gekk <max.gekk@gmail.com>
105 lines
11 KiB
Plaintext
105 lines
11 KiB
Plaintext
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
cast to timestamp 400 407 7 25.0 40.0 1.0X
|
|
YEAR of timestamp 1031 1099 59 9.7 103.1 0.4X
|
|
YEAROFWEEK of timestamp 1134 1178 39 8.8 113.4 0.4X
|
|
QUARTER of timestamp 1179 1225 44 8.5 117.9 0.3X
|
|
MONTH of timestamp 1064 1092 33 9.4 106.4 0.4X
|
|
WEEK of timestamp 2260 2304 42 4.4 226.0 0.2X
|
|
DAY of timestamp 1124 1162 35 8.9 112.4 0.4X
|
|
DAYOFWEEK of timestamp 1225 1250 30 8.2 122.5 0.3X
|
|
DOW of timestamp 1231 1247 27 8.1 123.1 0.3X
|
|
DOW_ISO of timestamp 1196 1209 15 8.4 119.6 0.3X
|
|
DAYOFWEEK_ISO of timestamp 1222 1236 12 8.2 122.2 0.3X
|
|
DOY of timestamp 1091 1105 16 9.2 109.1 0.4X
|
|
HOUR of timestamp 836 854 31 12.0 83.6 0.5X
|
|
MINUTE of timestamp 803 837 34 12.5 80.3 0.5X
|
|
SECOND of timestamp 990 1025 46 10.1 99.0 0.4X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
cast to timestamp 378 387 10 26.5 37.8 1.0X
|
|
YEAR of timestamp 1089 1110 25 9.2 108.9 0.3X
|
|
YEAROFWEEK of timestamp 1223 1277 70 8.2 122.3 0.3X
|
|
QUARTER of timestamp 1322 1365 45 7.6 132.2 0.3X
|
|
MONTH of timestamp 1185 1195 10 8.4 118.5 0.3X
|
|
WEEK of timestamp 2187 2239 48 4.6 218.7 0.2X
|
|
DAY of timestamp 1087 1105 32 9.2 108.7 0.3X
|
|
DAYOFWEEK of timestamp 1223 1252 28 8.2 122.3 0.3X
|
|
DOW of timestamp 1294 1336 37 7.7 129.4 0.3X
|
|
DOW_ISO of timestamp 1259 1286 25 7.9 125.9 0.3X
|
|
DAYOFWEEK_ISO of timestamp 1200 1229 25 8.3 120.0 0.3X
|
|
DOY of timestamp 1084 1111 30 9.2 108.4 0.3X
|
|
HOUR of timestamp 829 878 43 12.1 82.9 0.5X
|
|
MINUTE of timestamp 809 839 26 12.4 80.9 0.5X
|
|
SECOND of timestamp 1069 1102 44 9.4 106.9 0.4X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
cast to date 900 912 12 11.1 90.0 1.0X
|
|
YEAR of date 1112 1126 12 9.0 111.2 0.8X
|
|
YEAROFWEEK of date 1257 1271 17 8.0 125.7 0.7X
|
|
QUARTER of date 1177 1202 22 8.5 117.7 0.8X
|
|
MONTH of date 1053 1115 59 9.5 105.3 0.9X
|
|
WEEK of date 2232 2290 59 4.5 223.2 0.4X
|
|
DAY of date 1124 1136 11 8.9 112.4 0.8X
|
|
DAYOFWEEK of date 1247 1255 11 8.0 124.7 0.7X
|
|
DOW of date 1229 1275 40 8.1 122.9 0.7X
|
|
DOW_ISO of date 1175 1192 21 8.5 117.5 0.8X
|
|
DAYOFWEEK_ISO of date 1147 1172 24 8.7 114.7 0.8X
|
|
DOY of date 1087 1123 32 9.2 108.7 0.8X
|
|
HOUR of date 1603 1707 90 6.2 160.3 0.6X
|
|
MINUTE of date 1647 1704 49 6.1 164.7 0.5X
|
|
SECOND of date 1846 1879 39 5.4 184.6 0.5X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
cast to date 846 889 37 11.8 84.6 1.0X
|
|
YEAR of date 1020 1071 46 9.8 102.0 0.8X
|
|
YEAROFWEEK of date 1288 1303 18 7.8 128.8 0.7X
|
|
QUARTER of date 1181 1201 22 8.5 118.1 0.7X
|
|
MONTH of date 1021 1076 48 9.8 102.1 0.8X
|
|
WEEK of date 2145 2186 42 4.7 214.5 0.4X
|
|
DAY of date 1084 1103 26 9.2 108.4 0.8X
|
|
DAYOFWEEK of date 1201 1233 41 8.3 120.1 0.7X
|
|
DOW of date 1246 1281 34 8.0 124.6 0.7X
|
|
DOW_ISO of date 1136 1141 4 8.8 113.6 0.7X
|
|
DAYOFWEEK_ISO of date 1209 1234 30 8.3 120.9 0.7X
|
|
DOY of date 1083 1144 57 9.2 108.3 0.8X
|
|
HOUR of date 1632 1654 24 6.1 163.2 0.5X
|
|
MINUTE of date 1681 1716 31 6.0 168.1 0.5X
|
|
SECOND of date 1838 1902 60 5.4 183.8 0.5X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
Invoke extract for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
cast to interval 1285 1304 16 7.8 128.5 1.0X
|
|
YEAR of interval 1356 1384 24 7.4 135.6 0.9X
|
|
MONTH of interval 1349 1370 19 7.4 134.9 1.0X
|
|
DAY of interval 1306 1345 51 7.7 130.6 1.0X
|
|
HOUR of interval 1351 1400 44 7.4 135.1 1.0X
|
|
MINUTE of interval 1339 1410 74 7.5 133.9 1.0X
|
|
SECOND of interval 1365 1402 32 7.3 136.5 0.9X
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|
Invoke date_part for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------------------------------
|
|
cast to interval 1274 1334 58 7.9 127.4 1.0X
|
|
YEAR of interval 1329 1359 27 7.5 132.9 1.0X
|
|
MONTH of interval 1310 1362 45 7.6 131.0 1.0X
|
|
DAY of interval 1473 1500 26 6.8 147.3 0.9X
|
|
HOUR of interval 1308 1369 57 7.6 130.8 1.0X
|
|
MINUTE of interval 1333 1379 76 7.5 133.3 1.0X
|
|
SECOND of interval 1423 1448 36 7.0 142.3 0.9X
|
|
|