ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/sql/core/benchmarks/ExtractBenchmark-results.txt
HyukjinKwon ebf01ec3c1 [SPARK-34950][TESTS] Update benchmark results to the ones created by GitHub Actions machines 
### What changes were proposed in this pull request?

https://github.com/apache/spark/pull/32015 added a way to run benchmarks much more easily in the same GitHub Actions build. This PR updates the benchmark results by using the way.

**NOTE** that looks like GitHub Actions use four types of CPU given my observations:

- Intel(R) Xeon(R) Platinum 8171M CPU  2.60GHz
- Intel(R) Xeon(R) CPU E5-2673 v4  2.30GHz
- Intel(R) Xeon(R) CPU E5-2673 v3  2.40GHz
- Intel(R) Xeon(R) Platinum 8272CL CPU  2.60GHz

Given my quick research, seems like they perform roughly similarly:

![Screen Shot 2021-04-03 at 9 31 23 PM](https://user-images.githubusercontent.com/6477701/113478478-f4b57b80-94c3-11eb-9047-f81ca8c59672.png)

I couldn't find enough information about Intel(R) Xeon(R) Platinum 8272CL CPU  2.60GHz but the performance seems roughly similar given the numbers.

So shouldn't be a big deal especially given that this way is much easier, encourages contributors to run more and guarantee the same number of cores and same memory with the same softwares.

### Why are the changes needed?

To have a base line of the benchmarks accordingly.

### Does this PR introduce _any_ user-facing change?

No, dev-only.

### How was this patch tested?

It was generated from:

- [Run benchmarks: * (JDK 11)](https://github.com/HyukjinKwon/spark/actions/runs/713575465)
- [Run benchmarks: * (JDK 8)](https://github.com/HyukjinKwon/spark/actions/runs/713154337)

Closes #32044 from HyukjinKwon/SPARK-34950.

Authored-by: HyukjinKwon <gurwls223@apache.org>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
2021-04-03 23:02:56 +03:00

105 lines
11 KiB
Plaintext
Raw Blame History

OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to timestamp 400 407 7 25.0 40.0 1.0X
YEAR of timestamp 1031 1099 59 9.7 103.1 0.4X
YEAROFWEEK of timestamp 1134 1178 39 8.8 113.4 0.4X
QUARTER of timestamp 1179 1225 44 8.5 117.9 0.3X
MONTH of timestamp 1064 1092 33 9.4 106.4 0.4X
WEEK of timestamp 2260 2304 42 4.4 226.0 0.2X
DAY of timestamp 1124 1162 35 8.9 112.4 0.4X
DAYOFWEEK of timestamp 1225 1250 30 8.2 122.5 0.3X
DOW of timestamp 1231 1247 27 8.1 123.1 0.3X
DOW_ISO of timestamp 1196 1209 15 8.4 119.6 0.3X
DAYOFWEEK_ISO of timestamp 1222 1236 12 8.2 122.2 0.3X
DOY of timestamp 1091 1105 16 9.2 109.1 0.4X
HOUR of timestamp 836 854 31 12.0 83.6 0.5X
MINUTE of timestamp 803 837 34 12.5 80.3 0.5X
SECOND of timestamp 990 1025 46 10.1 99.0 0.4X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to timestamp 378 387 10 26.5 37.8 1.0X
YEAR of timestamp 1089 1110 25 9.2 108.9 0.3X
YEAROFWEEK of timestamp 1223 1277 70 8.2 122.3 0.3X
QUARTER of timestamp 1322 1365 45 7.6 132.2 0.3X
MONTH of timestamp 1185 1195 10 8.4 118.5 0.3X
WEEK of timestamp 2187 2239 48 4.6 218.7 0.2X
DAY of timestamp 1087 1105 32 9.2 108.7 0.3X
DAYOFWEEK of timestamp 1223 1252 28 8.2 122.3 0.3X
DOW of timestamp 1294 1336 37 7.7 129.4 0.3X
DOW_ISO of timestamp 1259 1286 25 7.9 125.9 0.3X
DAYOFWEEK_ISO of timestamp 1200 1229 25 8.3 120.0 0.3X
DOY of timestamp 1084 1111 30 9.2 108.4 0.3X
HOUR of timestamp 829 878 43 12.1 82.9 0.5X
MINUTE of timestamp 809 839 26 12.4 80.9 0.5X
SECOND of timestamp 1069 1102 44 9.4 106.9 0.4X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to date 900 912 12 11.1 90.0 1.0X
YEAR of date 1112 1126 12 9.0 111.2 0.8X
YEAROFWEEK of date 1257 1271 17 8.0 125.7 0.7X
QUARTER of date 1177 1202 22 8.5 117.7 0.8X
MONTH of date 1053 1115 59 9.5 105.3 0.9X
WEEK of date 2232 2290 59 4.5 223.2 0.4X
DAY of date 1124 1136 11 8.9 112.4 0.8X
DAYOFWEEK of date 1247 1255 11 8.0 124.7 0.7X
DOW of date 1229 1275 40 8.1 122.9 0.7X
DOW_ISO of date 1175 1192 21 8.5 117.5 0.8X
DAYOFWEEK_ISO of date 1147 1172 24 8.7 114.7 0.8X
DOY of date 1087 1123 32 9.2 108.7 0.8X
HOUR of date 1603 1707 90 6.2 160.3 0.6X
MINUTE of date 1647 1704 49 6.1 164.7 0.5X
SECOND of date 1846 1879 39 5.4 184.6 0.5X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to date 846 889 37 11.8 84.6 1.0X
YEAR of date 1020 1071 46 9.8 102.0 0.8X
YEAROFWEEK of date 1288 1303 18 7.8 128.8 0.7X
QUARTER of date 1181 1201 22 8.5 118.1 0.7X
MONTH of date 1021 1076 48 9.8 102.1 0.8X
WEEK of date 2145 2186 42 4.7 214.5 0.4X
DAY of date 1084 1103 26 9.2 108.4 0.8X
DAYOFWEEK of date 1201 1233 41 8.3 120.1 0.7X
DOW of date 1246 1281 34 8.0 124.6 0.7X
DOW_ISO of date 1136 1141 4 8.8 113.6 0.7X
DAYOFWEEK_ISO of date 1209 1234 30 8.3 120.9 0.7X
DOY of date 1083 1144 57 9.2 108.3 0.8X
HOUR of date 1632 1654 24 6.1 163.2 0.5X
MINUTE of date 1681 1716 31 6.0 168.1 0.5X
SECOND of date 1838 1902 60 5.4 183.8 0.5X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Invoke extract for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to interval 1285 1304 16 7.8 128.5 1.0X
YEAR of interval 1356 1384 24 7.4 135.6 0.9X
MONTH of interval 1349 1370 19 7.4 134.9 1.0X
DAY of interval 1306 1345 51 7.7 130.6 1.0X
HOUR of interval 1351 1400 44 7.4 135.1 1.0X
MINUTE of interval 1339 1410 74 7.5 133.9 1.0X
SECOND of interval 1365 1402 32 7.3 136.5 0.9X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Invoke date_part for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to interval 1274 1334 58 7.9 127.4 1.0X
YEAR of interval 1329 1359 27 7.5 132.9 1.0X
MONTH of interval 1310 1362 45 7.6 131.0 1.0X
DAY of interval 1473 1500 26 6.8 147.3 0.9X
HOUR of interval 1308 1369 57 7.6 130.8 1.0X
MINUTE of interval 1333 1379 76 7.5 133.3 1.0X
SECOND of interval 1423 1448 36 7.0 142.3 0.9X
Reference in a new issue View git blame Copy permalink