ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

[SPARK-29320][TESTS] Compare sql/core module in JDK8/11 (Part 1)

Browse source 
### What changes were proposed in this pull request?

This PR regenerates the `sql/core` benchmarks in JDK8/11 to compare the result. In general, we compare the ratio instead of the time. However, in this PR, the average time is compared. This PR should be considered as a rough comparison.

**A. EXPECTED CASES(JDK11 is faster in general)**
- [x] BloomFilterBenchmark (JDK11 is faster except one case)
- [x] BuiltInDataSourceWriteBenchmark (JDK11 is faster at CSV/ORC)
- [x] CSVBenchmark (JDK11 is faster except five cases)
- [x] ColumnarBatchBenchmark (JDK11 is faster at `boolean`/`string` and some cases in `int`/`array`)
- [x] DatasetBenchmark (JDK11 is faster with `string`, but is slower for `long` type)
- [x] ExternalAppendOnlyUnsafeRowArrayBenchmark (JDK11 is faster except two cases)
- [x] ExtractBenchmark (JDK11 is faster except HOUR/MINUTE/SECOND/MILLISECONDS/MICROSECONDS)
- [x] HashedRelationMetricsBenchmark (JDK11 is faster)
- [x] JSONBenchmark (JDK11 is much faster except eight cases)
- [x] JoinBenchmark (JDK11 is faster except five cases)
- [x] OrcNestedSchemaPruningBenchmark (JDK11 is faster in nine cases)
- [x] PrimitiveArrayBenchmark (JDK11 is faster)
- [x] SortBenchmark (JDK11 is faster except `Arrays.sort` case)
- [x] UDFBenchmark (N/A, values are too small)
- [x] UnsafeArrayDataBenchmark (JDK11 is faster except one case)
- [x] WideTableBenchmark (JDK11 is faster except two cases)

**B. CASES WE NEED TO INVESTIGATE MORE LATER**
- [x] AggregateBenchmark (JDK11 is slower in general)
- [x] CompressionSchemeBenchmark (JDK11 is slower in general except `string`)
- [x] DataSourceReadBenchmark (JDK11 is slower in general)
- [x] DateTimeBenchmark (JDK11 is slightly slower in general except `parsing`)
- [x] MakeDateTimeBenchmark (JDK11 is slower except two cases)
- [x] MiscBenchmark (JDK11 is slower except ten cases)
- [x] OrcV2NestedSchemaPruningBenchmark (JDK11 is slower)
- [x] ParquetNestedSchemaPruningBenchmark (JDK11 is slower except six cases)
- [x] RangeBenchmark (JDK11 is slower except one case)

`FilterPushdownBenchmark/InExpressionBenchmark/WideSchemaBenchmark` will be compared later because it took long timer.

### Why are the changes needed?

According to the result, there are some difference between JDK8/JDK11.
This will be a baseline for the future improvement and comparison. Also, as a reproducible  environment, the following environment is used.
- Instance: `r3.xlarge`
- OS: `CentOS Linux release 7.5.1804 (Core)`
- JDK:
  - `OpenJDK Runtime Environment (build 1.8.0_222-b10)`
  - `OpenJDK Runtime Environment 18.9 (build 11.0.4+11-LTS)`

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

This is a test-only PR. We need to run benchmark.

Closes #26003 from dongjoon-hyun/SPARK-29320.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
This commit is contained in:
Dongjoon Hyun 2019-10-03 08:58:25 -07:00
parent 7aca0dd658
commit 854a0f752e
50 changed files with 3210 additions and 1296 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

143
sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,143 @@
================================================================================================
aggregate without grouping
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
agg w/o group wholestage off 55644 59484 NaN 37.7 26.5 1.0X
agg w/o group wholestage on 896 906 8 2340.7 0.4 62.1X
================================================================================================
stat functions
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
stddev wholestage off 8655 9022 519 12.1 82.5 1.0X
stddev wholestage on 1306 1323 13 80.3 12.5 6.6X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
kurtosis wholestage off 40795 41041 349 2.6 389.0 1.0X
kurtosis wholestage on 1441 1468 22 72.8 13.7 28.3X
================================================================================================
aggregate with linear keys
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 10559 10956 562 7.9 125.9 1.0X
codegen = T hashmap = F 6533 6567 34 12.8 77.9 1.6X
codegen = T hashmap = T 1362 1377 22 61.6 16.2 7.8X
================================================================================================
aggregate with randomized keys
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 12631 12634 3 6.6 150.6 1.0X
codegen = T hashmap = F 8434 8478 44 9.9 100.5 1.5X
codegen = T hashmap = T 2484 2598 117 33.8 29.6 5.1X
================================================================================================
aggregate with string key
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 4173 4204 44 5.0 199.0 1.0X
codegen = T hashmap = F 2664 2721 81 7.9 127.0 1.6X
codegen = T hashmap = T 1178 1219 59 17.8 56.2 3.5X
================================================================================================
aggregate with decimal key
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 3740 3747 9 5.6 178.3 1.0X
codegen = T hashmap = F 2398 2528 184 8.7 114.3 1.6X
codegen = T hashmap = T 638 644 7 32.9 30.4 5.9X
================================================================================================
aggregate with multiple key types
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 6874 6896 31 3.1 327.8 1.0X
codegen = T hashmap = F 3866 3886 28 5.4 184.3 1.8X
codegen = T hashmap = T 2619 2641 31 8.0 124.9 2.6X
================================================================================================
max function bytecode size of wholestagecodegen
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 793 806 19 0.8 1209.7 1.0X
codegen = T hugeMethodLimit = 10000 401 456 61 1.6 611.2 2.0X
codegen = T hugeMethodLimit = 1500 694 715 19 0.9 1059.3 1.1X
================================================================================================
cube
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cube wholestage off 3616 3630 19 1.4 689.8 1.0X
cube wholestage on 1819 1866 41 2.9 347.0 2.0X
================================================================================================
hash and BytesToBytesMap
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
UnsafeRowhash 321 321 1 65.4 15.3 1.0X
murmur3 hash 145 145 0 144.5 6.9 2.2X
fast hash 70 71 1 298.9 3.3 4.6X
arrayEqual 198 199 2 105.7 9.5 1.6X
Java HashMap (Long) 132 136 3 158.6 6.3 2.4X
Java HashMap (two ints) 152 156 4 138.3 7.2 2.1X
Java HashMap (UnsafeRow) 819 839 17 25.6 39.1 0.4X
LongToUnsafeRowMap (opt=false) 459 472 25 45.7 21.9 0.7X
LongToUnsafeRowMap (opt=true) 107 108 1 195.5 5.1 3.0X
BytesToBytesMap (off Heap) 1012 1019 10 20.7 48.3 0.3X
BytesToBytesMap (on Heap) 963 974 18 21.8 45.9 0.3X
Aggregate HashMap 41 43 2 515.1 1.9 7.9X

142
sql/core/benchmarks/AggregateBenchmark-results.txt
View file

@ -2,142 +2,142 @@
aggregate without grouping
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
agg w/o group: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
agg w/o group wholestage off 65374 / 70665 32.1 31.2 1.0X
agg w/o group wholestage on 1178 / 1209 1779.8 0.6 55.5X
agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
agg w/o group wholestage off 50499 52524 2863 41.5 24.1 1.0X
agg w/o group wholestage on 1163 1205 56 1803.1 0.6 43.4X
================================================================================================
stat functions
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
stddev: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
stddev wholestage off 8667 / 8851 12.1 82.7 1.0X
stddev wholestage on 1266 / 1273 82.8 12.1 6.8X
stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
stddev wholestage off 13393 13403 14 7.8 127.7 1.0X
stddev wholestage on 1291 1315 25 81.2 12.3 10.4X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
kurtosis: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
kurtosis wholestage off 41218 / 41231 2.5 393.1 1.0X
kurtosis wholestage on 1347 / 1357 77.8 12.8 30.6X
kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
kurtosis wholestage off 40131 40250 168 2.6 382.7 1.0X
kurtosis wholestage on 1435 1452 20 73.1 13.7 28.0X
================================================================================================
aggregate with linear keys
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w keys: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
codegen = F 9309 / 9389 9.0 111.0 1.0X
codegen = T hashmap = F 4417 / 4435 19.0 52.7 2.1X
codegen = T hashmap = T 1289 / 1298 65.1 15.4 7.2X
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 10008 10008 1 8.4 119.3 1.0X
codegen = T hashmap = F 5803 6158 370 14.5 69.2 1.7X
codegen = T hashmap = T 1332 1348 12 63.0 15.9 7.5X
================================================================================================
aggregate with randomized keys
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w keys: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
codegen = F 11424 / 11426 7.3 136.2 1.0X
codegen = T hashmap = F 6441 / 6496 13.0 76.8 1.8X
codegen = T hashmap = T 2333 / 2344 36.0 27.8 4.9X
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 11853 11988 191 7.1 141.3 1.0X
codegen = T hashmap = F 7469 7531 57 11.2 89.0 1.6X
codegen = T hashmap = T 2412 2436 24 34.8 28.8 4.9X
================================================================================================
aggregate with string key
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w string key: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
codegen = F 4751 / 4890 4.4 226.5 1.0X
codegen = T hashmap = F 3146 / 3182 6.7 150.0 1.5X
codegen = T hashmap = T 2211 / 2261 9.5 105.4 2.1X
Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 4880 4908 40 4.3 232.7 1.0X
codegen = T hashmap = F 3483 3505 26 6.0 166.1 1.4X
codegen = T hashmap = T 2362 2425 39 8.9 112.6 2.1X
================================================================================================
aggregate with decimal key
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w decimal key: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
codegen = F 3029 / 3062 6.9 144.4 1.0X
codegen = T hashmap = F 1534 / 1569 13.7 73.2 2.0X
codegen = T hashmap = T 575 / 578 36.5 27.4 5.3X
Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 3475 3516 58 6.0 165.7 1.0X
codegen = T hashmap = F 1939 1958 27 10.8 92.5 1.8X
codegen = T hashmap = T 599 609 9 35.0 28.6 5.8X
================================================================================================
aggregate with multiple key types
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Aggregate w multiple keys: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
codegen = F 7506 / 7521 2.8 357.9 1.0X
codegen = T hashmap = F 4791 / 4808 4.4 228.5 1.6X
codegen = T hashmap = T 3553 / 3585 5.9 169.4 2.1X
Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 7649 7675 37 2.7 364.7 1.0X
codegen = T hashmap = F 4729 4759 42 4.4 225.5 1.6X
codegen = T hashmap = T 3917 3929 16 5.4 186.8 2.0X
================================================================================================
max function bytecode size of wholestagecodegen
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
max function bytecode size: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
codegen = F 608 / 656 1.1 927.1 1.0X
codegen = T hugeMethodLimit = 10000 402 / 419 1.6 613.5 1.5X
codegen = T hugeMethodLimit = 1500 616 / 619 1.1 939.9 1.0X
max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 628 661 25 1.0 958.2 1.0X
codegen = T hugeMethodLimit = 10000 366 385 21 1.8 558.9 1.7X
codegen = T hugeMethodLimit = 1500 620 648 24 1.1 946.7 1.0X
================================================================================================
cube
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
cube: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
cube wholestage off 3229 / 3237 1.6 615.9 1.0X
cube wholestage on 1285 / 1306 4.1 245.2 2.5X
cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cube wholestage off 3225 3273 68 1.6 615.1 1.0X
cube wholestage on 1636 1680 56 3.2 312.0 2.0X
================================================================================================
hash and BytesToBytesMap
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
BytesToBytesMap: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
UnsafeRowhash 328 / 330 64.0 15.6 1.0X
murmur3 hash 167 / 167 125.4 8.0 2.0X
fast hash 84 / 85 249.0 4.0 3.9X
arrayEqual 192 / 192 109.3 9.1 1.7X
Java HashMap (Long) 144 / 147 145.9 6.9 2.3X
Java HashMap (two ints) 147 / 153 142.3 7.0 2.2X
Java HashMap (UnsafeRow) 785 / 788 26.7 37.4 0.4X
LongToUnsafeRowMap (opt=false) 456 / 457 46.0 21.8 0.7X
LongToUnsafeRowMap (opt=true) 125 / 125 168.3 5.9 2.6X
BytesToBytesMap (off Heap) 885 / 885 23.7 42.2 0.4X
BytesToBytesMap (on Heap) 860 / 864 24.4 41.0 0.4X
Aggregate HashMap 56 / 56 373.9 2.7 5.8X
BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
UnsafeRowhash 331 332 0 63.3 15.8 1.0X
murmur3 hash 148 148 0 141.4 7.1 2.2X
fast hash 75 76 6 280.6 3.6 4.4X
arrayEqual 176 176 0 119.0 8.4 1.9X
Java HashMap (Long) 140 144 6 149.7 6.7 2.4X
Java HashMap (two ints) 153 157 5 137.2 7.3 2.2X
Java HashMap (UnsafeRow) 845 852 6 24.8 40.3 0.4X
LongToUnsafeRowMap (opt=false) 463 482 26 45.3 22.1 0.7X
LongToUnsafeRowMap (opt=true) 118 120 6 178.1 5.6 2.8X
BytesToBytesMap (off Heap) 935 937 2 22.4 44.6 0.4X
BytesToBytesMap (on Heap) 897 901 5 23.4 42.8 0.4X
Aggregate HashMap 57 58 0 369.9 2.7 5.8X

24
sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,24 @@
================================================================================================
ORC Write
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter 17367 17786 592 5.8 173.7 1.0X
With bloom filter 20556 20596 57 4.9 205.6 0.8X
================================================================================================
ORC Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter 2204 2226 31 45.4 22.0 1.0X
With bloom filter 1415 1465 71 70.7 14.2 1.6X

20
sql/core/benchmarks/BloomFilterBenchmark-results.txt
View file

@ -2,23 +2,23 @@
ORC Write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write 100M rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Without bloom filter 16765 / 17587 6.0 167.7 1.0X
With bloom filter 20060 / 20626 5.0 200.6 0.8X
Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter 19489 19693 289 5.1 194.9 1.0X
With bloom filter 23045 23148 145 4.3 230.5 0.8X
================================================================================================
ORC Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Read a row from 100M rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Without bloom filter 1857 / 1904 53.9 18.6 1.0X
With bloom filter 1399 / 1437 71.5 14.0 1.3X
Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter 2038 2084 65 49.1 20.4 1.0X
With bloom filter 1465 1475 15 68.3 14.6 1.4X

60
sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,60 @@
================================================================================================
Parquet writer benchmark
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Output Single Int Column 2552 2690 195 6.2 162.2 1.0X
Output Single Double Column 2865 2892 38 5.5 182.2 0.9X
Output Int and String Column 7876 7885 12 2.0 500.7 0.3X
Output Partitions 5079 5871 1120 3.1 322.9 0.5X
Output Buckets 6980 6994 20 2.3 443.8 0.4X
================================================================================================
ORC writer benchmark
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
ORC writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Output Single Int Column 1799 1902 146 8.7 114.4 1.0X
Output Single Double Column 2268 2276 11 6.9 144.2 0.8X
Output Int and String Column 6650 6670 28 2.4 422.8 0.3X
Output Partitions 4697 4719 31 3.3 298.6 0.4X
Output Buckets 6394 6436 60 2.5 406.5 0.3X
================================================================================================
JSON writer benchmark
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
JSON writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Output Single Int Column 2778 3522 1052 5.7 176.6 1.0X
Output Single Double Column 4222 4269 67 3.7 268.4 0.7X
Output Int and String Column 10822 10845 33 1.5 688.0 0.3X
Output Partitions 5450 5523 104 2.9 346.5 0.5X
Output Buckets 10827 11622 1123 1.5 688.4 0.3X
================================================================================================
CSV writer benchmark
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
CSV writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Output Single Int Column 3649 3698 68 4.3 232.0 1.0X
Output Single Double Column 4612 4696 120 3.4 293.2 0.8X
Output Int and String Column 7334 7517 258 2.1 466.3 0.5X
Output Partitions 6386 6541 220 2.5 406.0 0.6X
Output Buckets 8692 9439 1057 1.8 552.6 0.4X

64
sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt
View file

@ -2,59 +2,59 @@
Parquet writer benchmark
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet writer benchmark: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Output Single Int Column 2354 / 2438 6.7 149.7 1.0X
Output Single Double Column 2462 / 2485 6.4 156.5 1.0X
Output Int and String Column 8083 / 8100 1.9 513.9 0.3X
Output Partitions 5015 / 5027 3.1 318.8 0.5X
Output Buckets 6883 / 6887 2.3 437.6 0.3X
Parquet writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Output Single Int Column 2537 2594 81 6.2 161.3 1.0X
Output Single Double Column 2615 2645 42 6.0 166.3 1.0X
Output Int and String Column 8931 8933 4 1.8 567.8 0.3X
Output Partitions 5011 5321 438 3.1 318.6 0.5X
Output Buckets 6789 6793 6 2.3 431.6 0.4X
================================================================================================
ORC writer benchmark
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
ORC writer benchmark: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Output Single Int Column 1769 / 1789 8.9 112.4 1.0X
Output Single Double Column 1989 / 2009 7.9 126.5 0.9X
Output Int and String Column 7323 / 7400 2.1 465.6 0.2X
Output Partitions 4374 / 4381 3.6 278.1 0.4X
Output Buckets 6086 / 6104 2.6 386.9 0.3X
ORC writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Output Single Int Column 1780 1937 222 8.8 113.2 1.0X
Output Single Double Column 2248 2265 23 7.0 142.9 0.8X
Output Int and String Column 7996 8031 49 2.0 508.4 0.2X
Output Partitions 4827 4939 159 3.3 306.9 0.4X
Output Buckets 6521 6595 104 2.4 414.6 0.3X
================================================================================================
JSON writer benchmark
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
JSON writer benchmark: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Output Single Int Column 2954 / 4085 5.3 187.8 1.0X
Output Single Double Column 3832 / 3837 4.1 243.6 0.8X
Output Int and String Column 9591 / 10336 1.6 609.8 0.3X
Output Partitions 4956 / 4994 3.2 315.1 0.6X
Output Buckets 6608 / 6676 2.4 420.1 0.4X
JSON writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Output Single Int Column 2791 2823 45 5.6 177.5 1.0X
Output Single Double Column 4078 5089 1431 3.9 259.3 0.7X
Output Int and String Column 10249 10296 66 1.5 651.6 0.3X
Output Partitions 5247 5296 69 3.0 333.6 0.5X
Output Buckets 8168 9714 2187 1.9 519.3 0.3X
================================================================================================
CSV writer benchmark
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
CSV writer benchmark: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Output Single Int Column 4118 / 4125 3.8 261.8 1.0X
Output Single Double Column 4888 / 4891 3.2 310.8 0.8X
Output Int and String Column 9788 / 9872 1.6 622.3 0.4X
Output Partitions 6578 / 6640 2.4 418.2 0.6X
Output Buckets 9125 / 9171 1.7 580.2 0.5X
CSV writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Output Single Int Column 4055 4200 205 3.9 257.8 1.0X
Output Single Double Column 4978 5010 45 3.2 316.5 0.8X
Output Int and String Column 9285 9294 13 1.7 590.3 0.4X
Output Partitions 6681 6738 80 2.4 424.8 0.6X
Output Buckets 9495 10052 787 1.7 603.7 0.4X

59
sql/core/benchmarks/CSVBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,59 @@
================================================================================================
Benchmark to measure CSV read/write performance
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parsing quoted values: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
One quoted string 56894 57106 184 0.0 1137889.9 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Wide rows with 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Select 1000 columns 220825 222234 2018 0.0 220825.5 1.0X
Select 100 columns 50507 50723 278 0.0 50506.6 4.4X
Select one column 38629 38642 16 0.0 38628.6 5.7X
count() 8549 8597 51 0.1 8549.2 25.8X
Select 100 columns, one bad input field 68309 68474 182 0.0 68309.2 3.2X
Select 100 columns, corrupt record field 74551 74701 136 0.0 74551.5 3.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Count a dataset with 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Select 10 columns + count() 27745 28050 276 0.4 2774.5 1.0X
Select 1 column + count() 19989 20315 319 0.5 1998.9 1.4X
count() 6091 6109 25 1.6 609.1 4.6X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Create a dataset of timestamps 2235 2301 59 4.5 223.5 1.0X
to_csv(timestamp) 16033 16205 153 0.6 1603.3 0.1X
write timestamps to files 13556 13685 167 0.7 1355.6 0.2X
Create a dataset of dates 2262 2290 44 4.4 226.2 1.0X
to_csv(date) 11122 11160 33 0.9 1112.2 0.2X
write dates to files 8436 8486 76 1.2 843.6 0.3X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
read timestamp text from files 2617 2644 26 3.8 261.7 1.0X
read timestamps from files 53245 53381 149 0.2 5324.5 0.0X
infer timestamps from files 103797 104026 257 0.1 10379.7 0.0X
read date text from files 2371 2378 7 4.2 237.1 1.1X
read date from files 41808 41929 177 0.2 4180.8 0.1X
infer date from files 35069 35336 458 0.3 3506.9 0.1X
timestamp strings 3104 3127 21 3.2 310.4 0.8X
parse timestamps from Dataset[String] 61888 62132 342 0.2 6188.8 0.0X
infer timestamps from Dataset[String] 112494 114609 1949 0.1 11249.4 0.0X
date strings 3558 3603 41 2.8 355.8 0.7X
parse dates from Dataset[String] 45871 46000 120 0.2 4587.1 0.1X
from_csv(timestamp) 56975 57035 53 0.2 5697.5 0.0X
from_csv(date) 43711 43795 74 0.2 4371.1 0.1X

78
sql/core/benchmarks/CSVBenchmark-results.txt
View file

@ -2,58 +2,58 @@
Benchmark to measure CSV read/write performance
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parsing quoted values: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
One quoted string 36998 37134 120 0.0 739953.1 1.0X
One quoted string 62603 62755 133 0.0 1252055.6 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Wide rows with 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Select 1000 columns 140620 141162 737 0.0 140620.5 1.0X
Select 100 columns 35170 35287 183 0.0 35170.0 4.0X
Select one column 27711 27927 187 0.0 27710.9 5.1X
count() 7707 7804 84 0.1 7707.4 18.2X
Select 100 columns, one bad input field 41762 41851 117 0.0 41761.8 3.4X
Select 100 columns, corrupt record field 48717 48761 44 0.0 48717.4 2.9X
Select 1000 columns 225032 225919 782 0.0 225031.7 1.0X
Select 100 columns 51982 52290 286 0.0 51982.1 4.3X
Select one column 40167 40283 133 0.0 40167.4 5.6X
count() 11435 11593 176 0.1 11435.1 19.7X
Select 100 columns, one bad input field 66864 66968 174 0.0 66864.1 3.4X
Select 100 columns, corrupt record field 79570 80418 1080 0.0 79569.5 2.8X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Count a dataset with 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Select 10 columns + count() 16001 16053 53 0.6 1600.1 1.0X
Select 1 column + count() 11571 11614 58 0.9 1157.1 1.4X
count() 4752 4766 18 2.1 475.2 3.4X
Select 10 columns + count() 23271 23389 103 0.4 2327.1 1.0X
Select 1 column + count() 18206 19772 NaN 0.5 1820.6 1.3X
count() 8500 8521 18 1.2 850.0 2.7X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Create a dataset of timestamps 1070 1072 2 9.3 107.0 1.0X
to_csv(timestamp) 10446 10746 344 1.0 1044.6 0.1X
write timestamps to files 9573 9659 101 1.0 957.3 0.1X
Create a dataset of dates 1245 1260 17 8.0 124.5 0.9X
to_csv(date) 7157 7167 11 1.4 715.7 0.1X
write dates to files 5415 5450 57 1.8 541.5 0.2X
Create a dataset of timestamps 2025 2068 66 4.9 202.5 1.0X
to_csv(timestamp) 22192 22983 879 0.5 2219.2 0.1X
write timestamps to files 15949 16030 72 0.6 1594.9 0.1X
Create a dataset of dates 2200 2234 32 4.5 220.0 0.9X
to_csv(date) 18268 18341 73 0.5 1826.8 0.1X
write dates to files 10495 10722 214 1.0 1049.5 0.2X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
read timestamp text from files 1880 1887 8 5.3 188.0 1.0X
read timestamps from files 27135 27180 43 0.4 2713.5 0.1X
infer timestamps from files 51426 51534 97 0.2 5142.6 0.0X
read date text from files 1618 1622 4 6.2 161.8 1.2X
read date from files 20207 20218 13 0.5 2020.7 0.1X
infer date from files 19418 19479 94 0.5 1941.8 0.1X
timestamp strings 2289 2300 13 4.4 228.9 0.8X
parse timestamps from Dataset[String] 29367 29391 24 0.3 2936.7 0.1X
infer timestamps from Dataset[String] 54782 54902 126 0.2 5478.2 0.0X
date strings 2508 2524 16 4.0 250.8 0.7X
parse dates from Dataset[String] 21884 21902 19 0.5 2188.4 0.1X
from_csv(timestamp) 27188 27723 477 0.4 2718.8 0.1X
from_csv(date) 21137 21191 84 0.5 2113.7 0.1X
read timestamp text from files 6491 6503 18 1.5 649.1 1.0X
read timestamps from files 56069 56795 874 0.2 5606.9 0.1X
infer timestamps from files 113383 114203 825 0.1 11338.3 0.1X
read date text from files 6411 6419 10 1.6 641.1 1.0X
read date from files 46245 46371 138 0.2 4624.5 0.1X
infer date from files 43623 43906 291 0.2 4362.3 0.1X
timestamp strings 4951 4959 7 2.0 495.1 1.3X
parse timestamps from Dataset[String] 65786 66309 663 0.2 6578.6 0.1X
infer timestamps from Dataset[String] 130891 133861 1928 0.1 13089.1 0.0X
date strings 3814 3895 84 2.6 381.4 1.7X
parse dates from Dataset[String] 52259 52960 614 0.2 5225.9 0.1X
from_csv(timestamp) 63013 63306 291 0.2 6301.3 0.1X
from_csv(date) 49840 52352 NaN 0.2 4984.0 0.1X

59
sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,59 @@
================================================================================================
Int Read/Write
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Int Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Java Array 233 234 0 1406.0 0.7 1.0X
ByteBuffer Unsafe 396 397 0 826.5 1.2 0.6X
ByteBuffer API 603 605 3 543.0 1.8 0.4X
DirectByteBuffer 1189 1196 9 275.6 3.6 0.2X
Unsafe Buffer 321 324 3 1022.0 1.0 0.7X
Column(on heap) 235 236 2 1393.1 0.7 1.0X
Column(off heap) 524 526 1 624.8 1.6 0.4X
Column(off heap direct) 317 318 1 1034.1 1.0 0.7X
UnsafeRow (on heap) 690 693 3 474.8 2.1 0.3X
UnsafeRow (off heap) 642 646 3 510.1 2.0 0.4X
Column On Heap Append 522 527 4 628.0 1.6 0.4X
================================================================================================
Boolean Read/Write
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Boolean Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Bitset 778 780 3 431.1 2.3 1.0X
Byte Array 355 356 1 944.9 1.1 2.2X
================================================================================================
String Read/Write
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
On Heap 447 453 5 36.6 27.3 1.0X
Off Heap 652 658 4 25.1 39.8 0.7X
================================================================================================
Array Vector Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Array Vector Read: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
On Heap Read Size Only 101 102 0 1616.4 0.6 1.0X
Off Heap Read Size Only 305 307 2 536.8 1.9 0.3X
On Heap Read Elements 4255 4256 1 38.5 26.0 0.0X
Off Heap Read Elements 6097 6104 10 26.9 37.2 0.0X

62
sql/core/benchmarks/ColumnarBatchBenchmark-results.txt
View file

@ -2,58 +2,58 @@
Int Read/Write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Int Read/Write: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Java Array 244 / 244 1342.3 0.7 1.0X
ByteBuffer Unsafe 445 / 445 736.5 1.4 0.5X
ByteBuffer API 2124 / 2125 154.3 6.5 0.1X
DirectByteBuffer 750 / 750 437.2 2.3 0.3X
Unsafe Buffer 234 / 236 1401.3 0.7 1.0X
Column(on heap) 245 / 245 1335.6 0.7 1.0X
Column(off heap) 489 / 489 670.3 1.5 0.5X
Column(off heap direct) 236 / 236 1388.1 0.7 1.0X
UnsafeRow (on heap) 532 / 534 616.0 1.6 0.5X
UnsafeRow (off heap) 564 / 565 580.7 1.7 0.4X
Column On Heap Append 489 / 489 670.6 1.5 0.5X
Int Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Java Array 246 246 0 1333.2 0.8 1.0X
ByteBuffer Unsafe 446 447 1 734.6 1.4 0.6X
ByteBuffer API 2141 2144 4 153.0 6.5 0.1X
DirectByteBuffer 745 745 0 439.9 2.3 0.3X
Unsafe Buffer 237 240 1 1379.7 0.7 1.0X
Column(on heap) 247 247 0 1327.3 0.8 1.0X
Column(off heap) 487 488 1 673.1 1.5 0.5X
Column(off heap direct) 242 243 1 1354.1 0.7 1.0X
UnsafeRow (on heap) 541 543 1 605.4 1.7 0.5X
UnsafeRow (off heap) 581 583 2 563.7 1.8 0.4X
Column On Heap Append 520 521 1 629.8 1.6 0.5X
================================================================================================
Boolean Read/Write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Boolean Read/Write: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Bitset 879 / 879 381.9 2.6 1.0X
Byte Array 794 / 794 422.6 2.4 1.1X
Boolean Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Bitset 883 883 1 380.1 2.6 1.0X
Byte Array 775 777 2 432.9 2.3 1.1X
================================================================================================
String Read/Write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String Read/Write: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
On Heap 449 / 449 36.5 27.4 1.0X
Off Heap 679 / 679 24.1 41.4 0.7X
String Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
On Heap 463 470 10 35.4 28.3 1.0X
Off Heap 676 677 2 24.2 41.2 0.7X
================================================================================================
Array Vector Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Array Vector Read: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
On Heap Read Size Only 713 / 713 229.8 4.4 1.0X
Off Heap Read Size Only 757 / 757 216.5 4.6 0.9X
On Heap Read Elements 3648 / 3650 44.9 22.3 0.2X
Off Heap Read Elements 5263 / 5265 31.1 32.1 0.1X
Array Vector Read: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
On Heap Read Size Only 422 422 0 388.7 2.6 1.0X
Off Heap Read Size Only 259 259 0 633.2 1.6 1.6X
On Heap Read Elements 3932 3960 39 41.7 24.0 0.1X
Off Heap Read Elements 5143 5173 43 31.9 31.4 0.1X

137
sql/core/benchmarks/CompressionSchemeBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,137 @@
================================================================================================
Compression Scheme Benchmark
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
BOOLEAN Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 3 3 0 21087.3 0.0 1.0X
RunLengthEncoding(2.514) 739 739 1 90.8 11.0 0.0X
BooleanBitSet(0.125) 378 379 1 177.4 5.6 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
BOOLEAN Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 147 147 1 456.1 2.2 1.0X
RunLengthEncoding 731 732 1 91.8 10.9 0.2X
BooleanBitSet 1410 1411 1 47.6 21.0 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SHORT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 7 7 0 9729.9 0.1 1.0X
RunLengthEncoding(1.491) 1576 1576 1 42.6 23.5 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SHORT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1151 1152 1 58.3 17.2 1.0X
RunLengthEncoding 1619 1621 3 41.4 24.1 0.7X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SHORT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 7 7 0 10135.7 0.1 1.0X
RunLengthEncoding(2.010) 1659 1660 0 40.4 24.7 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SHORT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1151 1151 1 58.3 17.2 1.0X
RunLengthEncoding 1655 1655 0 40.5 24.7 0.7X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
INT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 23 23 0 2952.8 0.3 1.0X
RunLengthEncoding(0.997) 2356 2356 0 28.5 35.1 0.0X
DictionaryEncoding(0.500) 1402 1402 0 47.9 20.9 0.0X
IntDelta(0.250) 213 213 0 315.2 3.2 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
INT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1319 1319 1 50.9 19.7 1.0X
RunLengthEncoding 1803 1806 5 37.2 26.9 0.7X
DictionaryEncoding 931 931 0 72.1 13.9 1.4X
IntDelta 817 821 4 82.2 12.2 1.6X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
INT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 23 23 0 2976.8 0.3 1.0X
RunLengthEncoding(1.337) 2552 2552 1 26.3 38.0 0.0X
DictionaryEncoding(0.501) 1377 1377 0 48.7 20.5 0.0X
IntDelta(0.250) 213 214 2 315.3 3.2 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
INT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1438 1439 1 46.7 21.4 1.0X
RunLengthEncoding 1987 1988 1 33.8 29.6 0.7X
DictionaryEncoding 1249 1250 0 53.7 18.6 1.2X
IntDelta 1135 1136 3 59.2 16.9 1.3X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LONG Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 45 45 0 1487.9 0.7 1.0X
RunLengthEncoding(0.750) 2496 2496 1 26.9 37.2 0.0X
DictionaryEncoding(0.250) 1433 1433 1 46.8 21.4 0.0X
LongDelta(0.125) 215 215 0 312.6 3.2 0.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LONG Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1468 1469 1 45.7 21.9 1.0X
RunLengthEncoding 1977 1981 6 33.9 29.5 0.7X
DictionaryEncoding 1248 1250 3 53.8 18.6 1.2X
LongDelta 838 840 2 80.1 12.5 1.8X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LONG Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 47 47 0 1437.2 0.7 1.0X
RunLengthEncoding(1.002) 2743 2744 0 24.5 40.9 0.0X
DictionaryEncoding(0.251) 2016 2016 0 33.3 30.0 0.0X
LongDelta(0.125) 215 217 5 312.1 3.2 0.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LONG Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1468 1468 0 45.7 21.9 1.0X
RunLengthEncoding 2020 2021 2 33.2 30.1 0.7X
DictionaryEncoding 1248 1248 0 53.8 18.6 1.2X
LongDelta 1131 1134 4 59.4 16.8 1.3X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
STRING Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 71 71 0 939.6 1.1 1.0X
RunLengthEncoding(0.890) 6050 6052 2 11.1 90.2 0.0X
DictionaryEncoding(0.167) 3723 3725 2 18.0 55.5 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
STRING Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 2804 2815 16 23.9 41.8 1.0X
RunLengthEncoding 3390 3391 1 19.8 50.5 0.8X
DictionaryEncoding 2901 2905 5 23.1 43.2 1.0X

200
sql/core/benchmarks/CompressionSchemeBenchmark-results.txt
View file

@ -2,136 +2,136 @@
Compression Scheme Benchmark
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
BOOLEAN Encode: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough(1.000) 4 / 4 17998.9 0.1 1.0X
RunLengthEncoding(2.501) 680 / 680 98.7 10.1 0.0X
BooleanBitSet(0.125) 365 / 365 183.9 5.4 0.0X
BOOLEAN Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 3 3 0 21114.6 0.0 1.0X
RunLengthEncoding(2.505) 694 696 4 96.7 10.3 0.0X
BooleanBitSet(0.125) 366 366 0 183.4 5.5 0.0X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
BOOLEAN Decode: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough 144 / 144 466.5 2.1 1.0X
RunLengthEncoding 679 / 679 98.9 10.1 0.2X
BooleanBitSet 1425 / 1431 47.1 21.2 0.1X
BOOLEAN Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 145 145 0 464.2 2.2 1.0X
RunLengthEncoding 735 735 0 91.3 10.9 0.2X
BooleanBitSet 1437 1437 1 46.7 21.4 0.1X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SHORT Encode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough(1.000) 7 / 7 10115.0 0.1 1.0X
RunLengthEncoding(1.494) 1671 / 1672 40.2 24.9 0.0X
SHORT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 7 7 0 9336.6 0.1 1.0X
RunLengthEncoding(1.494) 1912 1917 7 35.1 28.5 0.0X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SHORT Decode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough 1128 / 1128 59.5 16.8 1.0X
RunLengthEncoding 1630 / 1633 41.2 24.3 0.7X
SHORT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1104 1104 0 60.8 16.4 1.0X
RunLengthEncoding 1627 1628 0 41.2 24.3 0.7X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SHORT Encode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough(1.000) 7 / 7 10164.2 0.1 1.0X
RunLengthEncoding(1.989) 1562 / 1563 43.0 23.3 0.0X
SHORT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 7 7 0 9710.6 0.1 1.0X
RunLengthEncoding(2.003) 2021 2027 9 33.2 30.1 0.0X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SHORT Decode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough 1127 / 1127 59.6 16.8 1.0X
RunLengthEncoding 1629 / 1631 41.2 24.3 0.7X
SHORT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1104 1104 0 60.8 16.5 1.0X
RunLengthEncoding 1621 1621 0 41.4 24.1 0.7X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
INT Encode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough(1.000) 22 / 23 2983.2 0.3 1.0X
RunLengthEncoding(1.003) 2426 / 2427 27.7 36.1 0.0X
DictionaryEncoding(0.500) 958 / 958 70.1 14.3 0.0X
IntDelta(0.250) 286 / 286 235.0 4.3 0.1X
INT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 24 24 0 2854.3 0.4 1.0X
RunLengthEncoding(1.005) 2395 2396 2 28.0 35.7 0.0X
DictionaryEncoding(0.500) 1366 1366 0 49.1 20.3 0.0X
IntDelta(0.250) 286 287 0 234.2 4.3 0.1X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
INT Decode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough 1268 / 1269 52.9 18.9 1.0X
RunLengthEncoding 1906 / 1911 35.2 28.4 0.7X
DictionaryEncoding 981 / 982 68.4 14.6 1.3X
IntDelta 812 / 817 82.6 12.1 1.6X
INT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1248 1248 0 53.8 18.6 1.0X
RunLengthEncoding 1738 1739 2 38.6 25.9 0.7X
DictionaryEncoding 969 970 0 69.2 14.4 1.3X
IntDelta 777 779 1 86.3 11.6 1.6X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
INT Encode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough(1.000) 23 / 23 2926.9 0.3 1.0X
RunLengthEncoding(1.326) 2614 / 2614 25.7 38.9 0.0X
DictionaryEncoding(0.501) 1024 / 1024 65.5 15.3 0.0X
IntDelta(0.250) 286 / 286 234.7 4.3 0.1X
INT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 23 23 0 2874.4 0.3 1.0X
RunLengthEncoding(1.334) 2581 2581 0 26.0 38.5 0.0X
DictionaryEncoding(0.501) 1490 1490 0 45.0 22.2 0.0X
IntDelta(0.250) 286 286 0 234.5 4.3 0.1X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
INT Decode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough 1433 / 1433 46.8 21.4 1.0X
RunLengthEncoding 1923 / 1926 34.9 28.6 0.7X
DictionaryEncoding 1285 / 1285 52.2 19.2 1.1X
IntDelta 1129 / 1137 59.4 16.8 1.3X
INT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1389 1389 0 48.3 20.7 1.0X
RunLengthEncoding 1903 1903 0 35.3 28.4 0.7X
DictionaryEncoding 1231 1232 1 54.5 18.3 1.1X
IntDelta 1103 1108 7 60.8 16.4 1.3X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LONG Encode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough(1.000) 45 / 45 1495.6 0.7 1.0X
RunLengthEncoding(0.738) 2662 / 2663 25.2 39.7 0.0X
DictionaryEncoding(0.250) 1269 / 1269 52.9 18.9 0.0X
LongDelta(0.125) 450 / 450 149.1 6.7 0.1X
LONG Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 48 48 0 1405.2 0.7 1.0X
RunLengthEncoding(0.757) 2525 2525 1 26.6 37.6 0.0X
DictionaryEncoding(0.250) 1380 1381 1 48.6 20.6 0.0X
LongDelta(0.125) 474 474 0 141.7 7.1 0.1X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LONG Decode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough 1483 / 1483 45.3 22.1 1.0X
RunLengthEncoding 1875 / 1875 35.8 27.9 0.8X
DictionaryEncoding 1213 / 1214 55.3 18.1 1.2X
LongDelta 816 / 817 82.2 12.2 1.8X
LONG Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1348 1349 0 49.8 20.1 1.0X
RunLengthEncoding 1850 1851 2 36.3 27.6 0.7X
DictionaryEncoding 1190 1192 3 56.4 17.7 1.1X
LongDelta 801 801 0 83.8 11.9 1.7X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LONG Encode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough(1.000) 45 / 45 1489.3 0.7 1.0X
RunLengthEncoding(1.003) 2906 / 2906 23.1 43.3 0.0X
DictionaryEncoding(0.251) 1610 / 1610 41.7 24.0 0.0X
LongDelta(0.125) 451 / 451 148.7 6.7 0.1X
LONG Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 46 46 0 1451.2 0.7 1.0X
RunLengthEncoding(1.003) 2742 2743 1 24.5 40.9 0.0X
DictionaryEncoding(0.251) 1714 1715 0 39.1 25.5 0.0X
LongDelta(0.125) 476 476 0 140.9 7.1 0.1X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LONG Decode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough 1485 / 1485 45.2 22.1 1.0X
RunLengthEncoding 1889 / 1890 35.5 28.2 0.8X
DictionaryEncoding 1215 / 1216 55.2 18.1 1.2X
LongDelta 1107 / 1110 60.6 16.5 1.3X
LONG Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 1362 1363 1 49.3 20.3 1.0X
RunLengthEncoding 1862 1863 1 36.0 27.7 0.7X
DictionaryEncoding 1190 1192 3 56.4 17.7 1.1X
LongDelta 1079 1082 4 62.2 16.1 1.3X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
STRING Encode: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough(1.000) 67 / 68 994.5 1.0 1.0X
RunLengthEncoding(0.894) 5877 / 5882 11.4 87.6 0.0X
DictionaryEncoding(0.167) 3597 / 3602 18.7 53.6 0.0X
STRING Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough(1.000) 67 67 0 994.8 1.0 1.0X
RunLengthEncoding(0.888) 6135 6137 2 10.9 91.4 0.0X
DictionaryEncoding(0.167) 3747 3748 0 17.9 55.8 0.0X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
STRING Decode: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
PassThrough 3243 / 3244 20.7 48.3 1.0X
RunLengthEncoding 3598 / 3601 18.7 53.6 0.9X
DictionaryEncoding 3182 / 3182 21.1 47.4 1.0X
STRING Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
PassThrough 3180 3185 8 21.1 47.4 1.0X
RunLengthEncoding 3658 3660 3 18.3 54.5 0.9X
DictionaryEncoding 3292 3295 4 20.4 49.1 1.0X

252
sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,252 @@
================================================================================================
SQL Single Numeric Column Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 27115 27169 76 0.6 1723.9 1.0X
SQL Json 9061 9124 89 1.7 576.1 3.0X
SQL Parquet Vectorized 196 232 39 80.4 12.4 138.5X
SQL Parquet MR 2187 2216 40 7.2 139.1 12.4X
SQL ORC Vectorized 335 344 5 46.9 21.3 80.9X
SQL ORC MR 1757 1786 42 9.0 111.7 15.4X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 201 205 5 78.3 12.8 1.0X
ParquetReader Vectorized -> Row 91 92 1 173.2 5.8 2.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 27969 27972 4 0.6 1778.2 1.0X
SQL Json 10328 10389 87 1.5 656.6 2.7X
SQL Parquet Vectorized 217 237 24 72.5 13.8 128.8X
SQL Parquet MR 2494 2567 103 6.3 158.6 11.2X
SQL ORC Vectorized 310 321 10 50.8 19.7 90.3X
SQL ORC MR 1901 1907 9 8.3 120.9 14.7X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 272 280 10 57.8 17.3 1.0X
ParquetReader Vectorized -> Row 144 185 68 109.3 9.1 1.9X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 29507 29532 34 0.5 1876.0 1.0X
SQL Json 10463 10474 16 1.5 665.2 2.8X
SQL Parquet Vectorized 193 204 10 81.3 12.3 152.6X
SQL Parquet MR 2948 2954 7 5.3 187.5 10.0X
SQL ORC Vectorized 268 277 9 58.7 17.0 110.1X
SQL ORC MR 1910 1950 57 8.2 121.4 15.5X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 263 278 38 59.7 16.7 1.0X
ParquetReader Vectorized -> Row 259 266 9 60.7 16.5 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 36696 36771 106 0.4 2333.0 1.0X
SQL Json 13496 13520 34 1.2 858.0 2.7X
SQL Parquet Vectorized 282 292 9 55.7 17.9 130.0X
SQL Parquet MR 3358 3383 36 4.7 213.5 10.9X
SQL ORC Vectorized 409 414 5 38.5 26.0 89.7X
SQL ORC MR 2250 2275 35 7.0 143.1 16.3X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 360 372 15 43.6 22.9 1.0X
ParquetReader Vectorized -> Row 354 357 5 44.4 22.5 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 30462 30466 5 0.5 1936.7 1.0X
SQL Json 12916 12948 45 1.2 821.2 2.4X
SQL Parquet Vectorized 181 185 5 86.7 11.5 168.0X
SQL Parquet MR 2810 2820 14 5.6 178.7 10.8X
SQL ORC Vectorized 426 430 4 36.9 27.1 71.6X
SQL ORC MR 2106 2112 9 7.5 133.9 14.5X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 255 261 7 61.6 16.2 1.0X
ParquetReader Vectorized -> Row 285 288 5 55.1 18.1 0.9X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 36950 36979 41 0.4 2349.2 1.0X
SQL Json 18794 18795 2 0.8 1194.9 2.0X
SQL Parquet Vectorized 279 295 17 56.3 17.8 132.3X
SQL Parquet MR 3933 4025 130 4.0 250.0 9.4X
SQL ORC Vectorized 521 527 6 30.2 33.2 70.9X
SQL ORC MR 2290 2326 51 6.9 145.6 16.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 356 365 12 44.2 22.6 1.0X
ParquetReader Vectorized -> Row 350 352 2 45.0 22.2 1.0X
================================================================================================
Int and String Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 26764 26810 65 0.4 2552.4 1.0X
SQL Json 12107 12195 124 0.9 1154.6 2.2X
SQL Parquet Vectorized 2202 2210 10 4.8 210.0 12.2X
SQL Parquet MR 5297 5302 6 2.0 505.2 5.1X
SQL ORC Vectorized 2356 2372 23 4.5 224.7 11.4X
SQL ORC MR 4370 4419 70 2.4 416.8 6.1X
================================================================================================
Repeated String Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 19953 19966 18 0.5 1902.8 1.0X
SQL Json 7151 7220 98 1.5 681.9 2.8X
SQL Parquet Vectorized 692 695 3 15.1 66.0 28.8X
SQL Parquet MR 2859 2943 118 3.7 272.6 7.0X
SQL ORC Vectorized 535 540 5 19.6 51.0 37.3X
SQL ORC MR 2157 2162 8 4.9 205.7 9.3X
================================================================================================
Partitioned Table Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Data column - CSV 46775 46785 13 0.3 2973.9 1.0X
Data column - Json 13891 13893 2 1.1 883.2 3.4X
Data column - Parquet Vectorized 301 306 7 52.3 19.1 155.6X
Data column - Parquet MR 3565 3572 10 4.4 226.7 13.1X
Data column - ORC Vectorized 434 458 36 36.2 27.6 107.7X
Data column - ORC MR 2337 2354 24 6.7 148.6 20.0X
Partition column - CSV 10645 10688 61 1.5 676.8 4.4X
Partition column - Json 10912 10973 87 1.4 693.7 4.3X
Partition column - Parquet Vectorized 93 103 9 169.4 5.9 503.8X
Partition column - Parquet MR 1588 1597 13 9.9 100.9 29.5X
Partition column - ORC Vectorized 92 99 11 170.7 5.9 507.6X
Partition column - ORC MR 1714 1716 3 9.2 109.0 27.3X
Both columns - CSV 46199 46222 32 0.3 2937.3 1.0X
Both columns - Json 17279 17291 18 0.9 1098.6 2.7X
Both columns - Parquet Vectorized 346 355 13 45.4 22.0 135.0X
Both columns - Parquet MR 3883 3908 35 4.1 246.9 12.0X
Both columns - ORC Vectorized 577 618 57 27.3 36.7 81.1X
Both columns - ORC MR 2967 3024 80 5.3 188.7 15.8X
================================================================================================
String with Nulls Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 23623 23731 153 0.4 2252.9 1.0X
SQL Json 13299 13432 187 0.8 1268.3 1.8X
SQL Parquet Vectorized 1464 1466 4 7.2 139.6 16.1X
SQL Parquet MR 7602 7628 37 1.4 724.9 3.1X
ParquetReader Vectorized 1032 1043 15 10.2 98.4 22.9X
SQL ORC Vectorized 1206 1211 7 8.7 115.0 19.6X
SQL ORC MR 4726 4991 374 2.2 450.7 5.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 23715 24152 619 0.4 2261.6 1.0X
SQL Json 10120 10280 226 1.0 965.1 2.3X
SQL Parquet Vectorized 1063 1072 13 9.9 101.4 22.3X
SQL Parquet MR 5460 5464 5 1.9 520.8 4.3X
ParquetReader Vectorized 934 936 4 11.2 89.0 25.4X
SQL ORC Vectorized 1094 1094 0 9.6 104.3 21.7X
SQL ORC MR 3964 4401 618 2.6 378.0 6.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 21348 21472 175 0.5 2035.9 1.0X
SQL Json 5877 5956 112 1.8 560.5 3.6X
SQL Parquet Vectorized 244 256 22 43.0 23.2 87.6X
SQL Parquet MR 3139 3371 328 3.3 299.4 6.8X
ParquetReader Vectorized 238 245 9 44.1 22.7 89.7X
SQL ORC Vectorized 378 383 7 27.7 36.0 56.5X
SQL ORC MR 2234 2315 115 4.7 213.0 9.6X
================================================================================================
Single Column Scan From Wide Columns
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Single Column Scan from 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 4053 4064 16 0.3 3865.4 1.0X
SQL Json 4115 4118 4 0.3 3924.6 1.0X
SQL Parquet Vectorized 72 82 11 14.5 69.0 56.0X
SQL Parquet MR 314 325 18 3.3 299.3 12.9X
SQL ORC Vectorized 80 86 8 13.1 76.2 50.7X
SQL ORC MR 250 253 2 4.2 238.5 16.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Single Column Scan from 50 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 7802 7849 66 0.1 7440.8 1.0X
SQL Json 16640 17481 1190 0.1 15868.8 0.5X
SQL Parquet Vectorized 106 126 31 9.9 101.0 73.7X
SQL Parquet MR 349 358 7 3.0 332.8 22.4X
SQL ORC Vectorized 108 115 10 9.7 102.7 72.5X
SQL ORC MR 284 298 20 3.7 270.5 27.5X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 12639 12672 47 0.1 12053.5 1.0X
SQL Json 30613 30688 106 0.0 29194.8 0.4X
SQL Parquet Vectorized 145 165 21 7.2 138.3 87.2X
SQL Parquet MR 384 393 9 2.7 366.4 32.9X
SQL ORC Vectorized 129 134 5 8.1 123.2 97.8X
SQL ORC MR 280 319 66 3.7 266.9 45.2X

234
sql/core/benchmarks/DataSourceReadBenchmark-results.txt
View file

@ -6,109 +6,109 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 23939 24126 265 0.7 1522.0 1.0X
SQL Json 8908 9008 142 1.8 566.4 2.7X
SQL Parquet Vectorized 192 229 36 82.1 12.2 125.0X
SQL Parquet MR 2356 2363 10 6.7 149.8 10.2X
SQL ORC Vectorized 329 347 25 47.9 20.9 72.9X
SQL ORC MR 1711 1747 50 9.2 108.8 14.0X
SQL CSV 23037 23172 191 0.7 1464.7 1.0X
SQL Json 8682 8686 5 1.8 552.0 2.7X
SQL Parquet Vectorized 183 205 32 85.9 11.6 125.8X
SQL Parquet MR 2189 2200 15 7.2 139.2 10.5X
SQL ORC Vectorized 296 306 5 53.1 18.8 77.7X
SQL ORC MR 1705 1717 18 9.2 108.4 13.5X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 194 197 4 81.1 12.3 1.0X
ParquetReader Vectorized -> Row 97 102 13 162.3 6.2 2.0X
ParquetReader Vectorized 195 200 7 80.9 12.4 1.0X
ParquetReader Vectorized -> Row 96 97 2 163.0 6.1 2.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 24603 24607 6 0.6 1564.2 1.0X
SQL Json 9587 9652 92 1.6 609.5 2.6X
SQL Parquet Vectorized 227 241 13 69.4 14.4 108.6X
SQL Parquet MR 2432 2441 12 6.5 154.6 10.1X
SQL ORC Vectorized 320 327 8 49.2 20.3 76.9X
SQL ORC MR 1889 1921 46 8.3 120.1 13.0X
SQL CSV 25126 25265 196 0.6 1597.5 1.0X
SQL Json 9442 9445 4 1.7 600.3 2.7X
SQL Parquet Vectorized 228 240 7 69.1 14.5 110.4X
SQL Parquet MR 2432 2445 19 6.5 154.6 10.3X
SQL ORC Vectorized 315 319 6 49.9 20.0 79.8X
SQL ORC MR 1901 1916 21 8.3 120.9 13.2X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 290 294 8 54.3 18.4 1.0X
ParquetReader Vectorized -> Row 252 256 5 62.4 16.0 1.2X
ParquetReader Vectorized 293 302 9 53.6 18.7 1.0X
ParquetReader Vectorized -> Row 264 266 2 59.7 16.8 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 26742 26743 1 0.6 1700.2 1.0X
SQL Json 10855 10855 0 1.4 690.1 2.5X
SQL Parquet Vectorized 195 202 7 80.8 12.4 137.3X
SQL Parquet MR 2805 2806 0 5.6 178.4 9.5X
SQL ORC Vectorized 376 383 5 41.8 23.9 71.1X
SQL ORC MR 2021 2092 102 7.8 128.5 13.2X
SQL CSV 27419 27443 34 0.6 1743.3 1.0X
SQL Json 9831 9836 8 1.6 625.0 2.8X
SQL Parquet Vectorized 192 198 9 81.8 12.2 142.7X
SQL Parquet MR 2696 2740 62 5.8 171.4 10.2X
SQL ORC Vectorized 329 335 8 47.9 20.9 83.4X
SQL ORC MR 1932 2006 105 8.1 122.8 14.2X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 248 253 5 63.4 15.8 1.0X
ParquetReader Vectorized -> Row 249 251 2 63.1 15.9 1.0X
ParquetReader Vectorized 248 253 6 63.5 15.8 1.0X
ParquetReader Vectorized -> Row 250 256 7 62.9 15.9 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 34841 34855 20 0.5 2215.1 1.0X
SQL Json 14121 14133 18 1.1 897.8 2.5X
SQL Parquet Vectorized 288 303 17 54.7 18.3 121.2X
SQL Parquet MR 3178 3197 27 4.9 202.0 11.0X
SQL ORC Vectorized 465 476 8 33.8 29.6 74.9X
SQL ORC MR 2255 2260 6 7.0 143.4 15.4X
SQL CSV 34898 34907 14 0.5 2218.7 1.0X
SQL Json 12760 12764 5 1.2 811.3 2.7X
SQL Parquet Vectorized 283 289 5 55.6 18.0 123.3X
SQL Parquet MR 3238 3240 3 4.9 205.9 10.8X
SQL ORC Vectorized 401 405 7 39.2 25.5 87.0X
SQL ORC MR 2274 2290 23 6.9 144.6 15.3X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 344 354 11 45.8 21.8 1.0X
ParquetReader Vectorized -> Row 383 385 3 41.1 24.3 0.9X
ParquetReader Vectorized 339 351 16 46.5 21.5 1.0X
ParquetReader Vectorized -> Row 342 348 13 46.0 21.8 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 29336 29563 322 0.5 1865.1 1.0X
SQL Json 13452 13544 130 1.2 855.3 2.2X
SQL Parquet Vectorized 186 200 22 84.8 11.8 158.1X
SQL Parquet MR 2752 2815 90 5.7 175.0 10.7X
SQL ORC Vectorized 460 465 6 34.2 29.3 63.7X
SQL ORC MR 2054 2072 26 7.7 130.6 14.3X
SQL CSV 28872 28886 20 0.5 1835.6 1.0X
SQL Json 13360 13377 24 1.2 849.4 2.2X
SQL Parquet Vectorized 181 185 6 86.8 11.5 159.3X
SQL Parquet MR 2645 2651 8 5.9 168.2 10.9X
SQL ORC Vectorized 456 459 5 34.5 29.0 63.4X
SQL ORC MR 2047 2066 26 7.7 130.2 14.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 244 246 4 64.6 15.5 1.0X
ParquetReader Vectorized -> Row 247 250 4 63.7 15.7 1.0X
ParquetReader Vectorized 240 246 10 65.5 15.3 1.0X
ParquetReader Vectorized -> Row 245 246 2 64.2 15.6 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 37812 37897 120 0.4 2404.0 1.0X
SQL Json 19499 19509 15 0.8 1239.7 1.9X
SQL Parquet Vectorized 284 292 10 55.4 18.1 133.2X
SQL Parquet MR 3236 3248 17 4.9 205.7 11.7X
SQL ORC Vectorized 542 558 18 29.0 34.4 69.8X
SQL ORC MR 2273 2298 36 6.9 144.5 16.6X
SQL CSV 36298 36305 10 0.4 2307.7 1.0X
SQL Json 18250 18276 36 0.9 1160.3 2.0X
SQL Parquet Vectorized 278 285 7 56.5 17.7 130.4X
SQL Parquet MR 3144 3146 4 5.0 199.9 11.5X
SQL ORC Vectorized 533 546 16 29.5 33.9 68.1X
SQL ORC MR 2265 2302 53 6.9 144.0 16.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Parquet Reader Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized 342 352 13 46.0 21.7 1.0X
ParquetReader Vectorized -> Row 341 344 3 46.1 21.7 1.0X
ParquetReader Vectorized 338 346 12 46.6 21.5 1.0X
ParquetReader Vectorized -> Row 338 344 9 46.5 21.5 1.0X
================================================================================================
@ -119,12 +119,12 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 26777 26806 41 0.4 2553.7 1.0X
SQL Json 13894 14071 251 0.8 1325.0 1.9X
SQL Parquet Vectorized 2351 2404 75 4.5 224.2 11.4X
SQL Parquet MR 5198 5219 29 2.0 495.8 5.2X
SQL ORC Vectorized 2434 2435 1 4.3 232.1 11.0X
SQL ORC MR 4281 4345 91 2.4 408.3 6.3X
SQL CSV 24839 25273 613 0.4 2368.9 1.0X
SQL Json 11861 11869 11 0.9 1131.2 2.1X
SQL Parquet Vectorized 2298 2305 9 4.6 219.2 10.8X
SQL Parquet MR 5045 5053 10 2.1 481.2 4.9X
SQL ORC Vectorized 2391 2405 21 4.4 228.0 10.4X
SQL ORC MR 4561 4645 118 2.3 435.0 5.4X
================================================================================================
@ -135,12 +135,12 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 15779 16507 1029 0.7 1504.8 1.0X
SQL Json 7866 7877 14 1.3 750.2 2.0X
SQL Parquet Vectorized 820 826 5 12.8 78.2 19.2X
SQL Parquet MR 2646 2658 17 4.0 252.4 6.0X
SQL ORC Vectorized 638 644 7 16.4 60.9 24.7X
SQL ORC MR 2205 2222 25 4.8 210.3 7.2X
SQL CSV 14147 14244 137 0.7 1349.1 1.0X
SQL Json 7289 7306 23 1.4 695.1 1.9X
SQL Parquet Vectorized 818 821 4 12.8 78.0 17.3X
SQL Parquet MR 2562 2570 11 4.1 244.4 5.5X
SQL ORC Vectorized 571 579 8 18.3 54.5 24.8X
SQL ORC MR 2143 2164 31 4.9 204.3 6.6X
================================================================================================
@ -151,24 +151,24 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Data column - CSV 38142 38183 58 0.4 2425.0 1.0X
Data column - Json 14664 14667 4 1.1 932.3 2.6X
Data column - Parquet Vectorized 304 318 13 51.8 19.3 125.7X
Data column - Parquet MR 3378 3384 8 4.7 214.8 11.3X
Data column - ORC Vectorized 475 481 7 33.1 30.2 80.3X
Data column - ORC MR 2324 2356 46 6.8 147.7 16.4X
Partition column - CSV 14680 14742 88 1.1 933.3 2.6X
Partition column - Json 11200 11251 73 1.4 712.1 3.4X
Partition column - Parquet Vectorized 102 111 14 154.7 6.5 375.1X
Partition column - Parquet MR 1477 1483 9 10.7 93.9 25.8X
Partition column - ORC Vectorized 100 112 18 157.4 6.4 381.6X
Partition column - ORC MR 1675 1685 15 9.4 106.5 22.8X
Both columns - CSV 41925 41929 6 0.4 2665.5 0.9X
Both columns - Json 15409 15422 18 1.0 979.7 2.5X
Both columns - Parquet Vectorized 351 358 10 44.8 22.3 108.7X
Both columns - Parquet MR 3719 3720 2 4.2 236.4 10.3X
Both columns - ORC Vectorized 609 630 23 25.8 38.7 62.6X
Both columns - ORC MR 2959 2959 1 5.3 188.1 12.9X
Data column - CSV 38652 38680 40 0.4 2457.4 1.0X
Data column - Json 12756 12760 5 1.2 811.0 3.0X
Data column - Parquet Vectorized 304 314 9 51.7 19.3 127.2X
Data column - Parquet MR 3387 3393 9 4.6 215.3 11.4X
Data column - ORC Vectorized 425 436 10 37.0 27.0 91.0X
Data column - ORC MR 2303 2330 38 6.8 146.4 16.8X
Partition column - CSV 11239 11249 14 1.4 714.5 3.4X
Partition column - Json 10477 10479 3 1.5 666.1 3.7X
Partition column - Parquet Vectorized 95 102 9 165.5 6.0 406.7X
Partition column - Parquet MR 1574 1575 1 10.0 100.1 24.6X
Partition column - ORC Vectorized 95 106 20 166.3 6.0 408.5X
Partition column - ORC MR 1682 1693 15 9.4 106.9 23.0X
Both columns - CSV 39146 39203 81 0.4 2488.8 1.0X
Both columns - Json 14675 14691 23 1.1 933.0 2.6X
Both columns - Parquet Vectorized 347 351 3 45.3 22.1 111.4X
Both columns - Parquet MR 3680 3717 52 4.3 234.0 10.5X
Both columns - ORC Vectorized 556 565 8 28.3 35.3 69.6X
Both columns - ORC MR 2909 2923 20 5.4 184.9 13.3X
================================================================================================
@ -179,37 +179,37 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 19510 19709 282 0.5 1860.6 1.0X
SQL Json 11816 11822 8 0.9 1126.9 1.7X
SQL Parquet Vectorized 1535 1548 18 6.8 146.4 12.7X
SQL Parquet MR 5491 5514 33 1.9 523.6 3.6X
ParquetReader Vectorized 1126 1129 5 9.3 107.4 17.3X
SQL ORC Vectorized 1200 1215 21 8.7 114.5 16.3X
SQL ORC MR 3901 3904 4 2.7 372.1 5.0X
SQL CSV 17457 17740 401 0.6 1664.9 1.0X
SQL Json 12276 12287 16 0.9 1170.7 1.4X
SQL Parquet Vectorized 1525 1539 20 6.9 145.4 11.5X
SQL Parquet MR 5051 5098 66 2.1 481.7 3.5X
ParquetReader Vectorized 1115 1123 12 9.4 106.3 15.7X
SQL ORC Vectorized 1269 1294 37 8.3 121.0 13.8X
SQL ORC MR 3938 3951 17 2.7 375.6 4.4X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 21439 21457 26 0.5 2044.6 1.0X
SQL Json 9653 9669 22 1.1 920.6 2.2X
SQL Parquet Vectorized 1126 1131 8 9.3 107.4 19.0X
SQL Parquet MR 3947 3961 19 2.7 376.4 5.4X
ParquetReader Vectorized 998 1023 36 10.5 95.2 21.5X
SQL ORC Vectorized 1274 1277 4 8.2 121.5 16.8X
SQL ORC MR 3424 3425 1 3.1 326.5 6.3X
SQL CSV 18086 18119 47 0.6 1724.8 1.0X
SQL Json 8484 8851 520 1.2 809.1 2.1X
SQL Parquet Vectorized 1127 1131 5 9.3 107.5 16.0X
SQL Parquet MR 4120 4131 15 2.5 392.9 4.4X
ParquetReader Vectorized 984 1019 49 10.7 93.9 18.4X
SQL ORC Vectorized 1208 1211 4 8.7 115.2 15.0X
SQL ORC MR 3401 3410 13 3.1 324.4 5.3X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 17885 17893 11 0.6 1705.7 1.0X
SQL Json 5201 5210 13 2.0 496.0 3.4X
SQL Parquet Vectorized 261 267 6 40.2 24.9 68.6X
SQL Parquet MR 2841 2853 18 3.7 270.9 6.3X
ParquetReader Vectorized 244 246 3 43.1 23.2 73.4X
SQL ORC Vectorized 465 468 1 22.5 44.4 38.4X
SQL ORC MR 1904 1945 58 5.5 181.6 9.4X
SQL CSV 24825 24970 205 0.4 2367.5 1.0X
SQL Json 9847 9857 14 1.1 939.1 2.5X
SQL Parquet Vectorized 258 261 6 40.7 24.6 96.3X
SQL Parquet MR 3182 3242 85 3.3 303.4 7.8X
ParquetReader Vectorized 241 242 2 43.6 22.9 103.2X
SQL ORC Vectorized 453 456 4 23.1 43.2 54.8X
SQL ORC MR 1917 1927 13 5.5 182.8 12.9X
================================================================================================
@ -220,33 +220,33 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Single Column Scan from 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 3841 3861 28 0.3 3663.1 1.0X
SQL Json 3780 3787 10 0.3 3604.6 1.0X
SQL Parquet Vectorized 83 90 10 12.7 79.0 46.4X
SQL Parquet MR 291 303 18 3.6 277.9 13.2X
SQL ORC Vectorized 93 106 20 11.3 88.8 41.2X
SQL ORC MR 217 224 10 4.8 206.6 17.7X
SQL CSV 5163 5174 16 0.2 4923.5 1.0X
SQL Json 4459 4538 111 0.2 4252.7 1.2X
SQL Parquet Vectorized 78 84 8 13.4 74.7 65.9X
SQL Parquet MR 511 519 9 2.1 486.9 10.1X
SQL ORC Vectorized 86 93 11 12.2 82.1 60.0X
SQL ORC MR 350 359 7 3.0 333.6 14.8X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Single Column Scan from 50 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 8896 8971 106 0.1 8483.9 1.0X
SQL Json 14731 14773 59 0.1 14048.2 0.6X
SQL Parquet Vectorized 120 146 26 8.8 114.0 74.4X
SQL Parquet MR 330 363 33 3.2 314.4 27.0X
SQL ORC Vectorized 122 130 11 8.6 115.9 73.2X
SQL ORC MR 248 254 9 4.2 237.0 35.8X
SQL CSV 9839 9842 4 0.1 9383.4 1.0X
SQL Json 15887 15889 4 0.1 15150.7 0.6X
SQL Parquet Vectorized 115 125 11 9.1 109.9 85.4X
SQL Parquet MR 666 671 8 1.6 635.4 14.8X
SQL ORC Vectorized 115 120 6 9.1 110.1 85.2X
SQL ORC MR 455 458 3 2.3 433.7 21.6X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 14771 14817 65 0.1 14086.3 1.0X
SQL Json 29677 29787 157 0.0 28302.0 0.5X
SQL Parquet Vectorized 182 191 13 5.8 173.8 81.1X
SQL Parquet MR 1209 1213 5 0.9 1153.1 12.2X
SQL ORC Vectorized 165 176 17 6.3 157.7 89.3X
SQL ORC MR 809 813 4 1.3 771.4 18.3X
SQL CSV 15858 15891 46 0.1 15123.5 1.0X
SQL Json 30200 30256 80 0.0 28800.6 0.5X
SQL Parquet Vectorized 160 165 7 6.5 153.0 98.8X
SQL Parquet MR 682 690 7 1.5 650.3 23.3X
SQL ORC Vectorized 143 150 10 7.4 136.0 111.2X
SQL ORC MR 494 509 15 2.1 471.4 32.1X

46
sql/core/benchmarks/DatasetBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,46 @@
================================================================================================
Dataset Benchmark
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
back-to-back map long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 14574 14759 261 6.9 145.7 1.0X
DataFrame 2468 2655 264 40.5 24.7 5.9X
Dataset 3498 3533 50 28.6 35.0 4.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
back-to-back map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 17877 18133 361 5.6 178.8 1.0X
DataFrame 5968 5991 33 16.8 59.7 3.0X
Dataset 12638 12859 313 7.9 126.4 1.4X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
back-to-back filter Long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 3399 3464 92 29.4 34.0 1.0X
DataFrame 1609 1628 28 62.2 16.1 2.1X
Dataset 3637 3648 16 27.5 36.4 0.9X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
back-to-back filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 4850 4859 13 20.6 48.5 1.0X
DataFrame 211 244 21 472.9 2.1 22.9X
Dataset 5864 6126 372 17.1 58.6 0.8X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
aggregate: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD sum 4821 4914 131 20.7 48.2 1.0X
DataFrame sum 71 83 8 1412.4 0.7 68.1X
Dataset sum using Aggregator 6001 6012 16 16.7 60.0 0.8X
Dataset complex Aggregator 10247 10455 294 9.8 102.5 0.5X

62
sql/core/benchmarks/DatasetBenchmark-results.txt
View file

@ -2,45 +2,45 @@
Dataset Benchmark
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
back-to-back map long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
RDD 11800 / 12042 8.5 118.0 1.0X
DataFrame 1927 / 2189 51.9 19.3 6.1X
Dataset 2483 / 2605 40.3 24.8 4.8X
back-to-back map long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 12720 12777 80 7.9 127.2 1.0X
DataFrame 2242 2501 366 44.6 22.4 5.7X
Dataset 3040 3174 189 32.9 30.4 4.2X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
back-to-back map: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
RDD 16286 / 16301 6.1 162.9 1.0X
DataFrame 8101 / 8104 12.3 81.0 2.0X
Dataset 17445 / 17811 5.7 174.4 0.9X
back-to-back map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 15865 15922 82 6.3 158.6 1.0X
DataFrame 8423 8476 75 11.9 84.2 1.9X
Dataset 17180 18142 1361 5.8 171.8 0.9X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
back-to-back filter Long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
RDD 2971 / 3184 33.7 29.7 1.0X
DataFrame 1243 / 1296 80.5 12.4 2.4X
Dataset 3062 / 3091 32.7 30.6 1.0X
back-to-back filter Long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 2928 3009 114 34.1 29.3 1.0X
DataFrame 1386 1427 59 72.2 13.9 2.1X
Dataset 3448 3451 5 29.0 34.5 0.8X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
back-to-back filter: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
RDD 5253 / 5269 19.0 52.5 1.0X
DataFrame 211 / 234 473.4 2.1 24.9X
Dataset 9550 / 9552 10.5 95.5 0.6X
back-to-back filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 5476 5483 10 18.3 54.8 1.0X
DataFrame 209 235 23 479.1 2.1 26.2X
Dataset 9433 9549 163 10.6 94.3 0.6X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
aggregate: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
RDD sum 5086 / 5108 19.7 50.9 1.0X
DataFrame sum 65 / 73 1548.9 0.6 78.8X
Dataset sum using Aggregator 9024 / 9320 11.1 90.2 0.6X
Dataset complex Aggregator 15079 / 15171 6.6 150.8 0.3X
aggregate: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD sum 5146 5239 132 19.4 51.5 1.0X
DataFrame sum 84 99 15 1196.9 0.8 61.6X
Dataset sum using Aggregator 8944 9021 109 11.2 89.4 0.6X
Dataset complex Aggregator 12832 13141 436 7.8 128.3 0.4X

429
sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,429 @@
================================================================================================
Extract components
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
cast to timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to timestamp wholestage off 460 486 36 21.7 46.0 1.0X
cast to timestamp wholestage on 412 455 70 24.3 41.2 1.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
year of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
year of timestamp wholestage off 1351 1351 1 7.4 135.1 1.0X
year of timestamp wholestage on 1277 1312 47 7.8 127.7 1.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
quarter of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
quarter of timestamp wholestage off 1591 1604 19 6.3 159.1 1.0X
quarter of timestamp wholestage on 1583 1600 12 6.3 158.3 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
month of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
month of timestamp wholestage off 1263 1268 7 7.9 126.3 1.0X
month of timestamp wholestage on 1281 1316 46 7.8 128.1 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
weekofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
weekofyear of timestamp wholestage off 1756 1757 1 5.7 175.6 1.0X
weekofyear of timestamp wholestage on 1748 1762 15 5.7 174.8 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
day of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
day of timestamp wholestage off 1250 1253 4 8.0 125.0 1.0X
day of timestamp wholestage on 1270 1285 13 7.9 127.0 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
dayofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
dayofyear of timestamp wholestage off 1295 1303 12 7.7 129.5 1.0X
dayofyear of timestamp wholestage on 1294 1308 16 7.7 129.4 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
dayofmonth of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
dayofmonth of timestamp wholestage off 1277 1311 48 7.8 127.7 1.0X
dayofmonth of timestamp wholestage on 1270 1288 24 7.9 127.0 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
dayofweek of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
dayofweek of timestamp wholestage off 1472 1472 0 6.8 147.2 1.0X
dayofweek of timestamp wholestage on 1434 1437 4 7.0 143.4 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
weekday of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
weekday of timestamp wholestage off 1363 1372 13 7.3 136.3 1.0X
weekday of timestamp wholestage on 1362 1368 3 7.3 136.2 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
hour of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
hour of timestamp wholestage off 748 753 7 13.4 74.8 1.0X
hour of timestamp wholestage on 749 756 9 13.4 74.9 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
minute of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
minute of timestamp wholestage off 722 725 4 13.9 72.2 1.0X
minute of timestamp wholestage on 750 754 4 13.3 75.0 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
second of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
second of timestamp wholestage off 614 620 8 16.3 61.4 1.0X
second of timestamp wholestage on 611 617 5 16.4 61.1 1.0X
================================================================================================
Current date and time
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
current_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
current_date wholestage off 291 298 10 34.4 29.1 1.0X
current_date wholestage on 303 316 13 33.0 30.3 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
current_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
current_timestamp wholestage off 328 355 39 30.5 32.8 1.0X
current_timestamp wholestage on 309 497 387 32.4 30.9 1.1X
================================================================================================
Date arithmetic
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
cast to date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to date wholestage off 1094 1103 12 9.1 109.4 1.0X
cast to date wholestage on 1105 1111 5 9.0 110.5 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
last_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
last_day wholestage off 1258 1258 0 7.9 125.8 1.0X
last_day wholestage on 1279 1289 9 7.8 127.9 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
next_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
next_day wholestage off 1148 1152 7 8.7 114.8 1.0X
next_day wholestage on 1148 1152 4 8.7 114.8 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_add: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_add wholestage off 1069 1074 6 9.4 106.9 1.0X
date_add wholestage on 1087 1091 4 9.2 108.7 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_sub: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_sub wholestage off 1076 1076 1 9.3 107.6 1.0X
date_sub wholestage on 1086 1094 7 9.2 108.6 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
add_months: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
add_months wholestage off 1442 1442 1 6.9 144.2 1.0X
add_months wholestage on 1406 1426 12 7.1 140.6 1.0X
================================================================================================
Formatting dates
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
format date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
format date wholestage off 5082 5179 138 2.0 508.2 1.0X
format date wholestage on 4899 4904 6 2.0 489.9 1.0X
================================================================================================
Formatting timestamps
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
from_unixtime: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
from_unixtime wholestage off 7148 7170 31 1.4 714.8 1.0X
from_unixtime wholestage on 7228 7235 9 1.4 722.8 1.0X
================================================================================================
Convert timestamps
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
from_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
from_utc_timestamp wholestage off 982 990 11 10.2 98.2 1.0X
from_utc_timestamp wholestage on 1053 1058 5 9.5 105.3 0.9X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to_utc_timestamp wholestage off 1063 1075 16 9.4 106.3 1.0X
to_utc_timestamp wholestage on 1121 1136 15 8.9 112.1 0.9X
================================================================================================
Intervals
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
cast interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast interval wholestage off 356 374 25 28.1 35.6 1.0X
cast interval wholestage on 341 353 14 29.3 34.1 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
datediff: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
datediff wholestage off 1883 1898 22 5.3 188.3 1.0X
datediff wholestage on 1854 1862 8 5.4 185.4 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
months_between: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
months_between wholestage off 1989 1996 10 5.0 198.9 1.0X
months_between wholestage on 2006 2041 36 5.0 200.6 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
window: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
window wholestage off 2761 2820 83 0.4 2761.1 1.0X
window wholestage on 47075 47156 75 0.0 47075.0 0.1X
================================================================================================
Truncation
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc YEAR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc YEAR wholestage off 916 919 5 10.9 91.6 1.0X
date_trunc YEAR wholestage on 902 904 2 11.1 90.2 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc YYYY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc YYYY wholestage off 909 915 9 11.0 90.9 1.0X
date_trunc YYYY wholestage on 902 909 5 11.1 90.2 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc YY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc YY wholestage off 916 925 12 10.9 91.6 1.0X
date_trunc YY wholestage on 903 908 4 11.1 90.3 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc MON: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc MON wholestage off 921 928 11 10.9 92.1 1.0X
date_trunc MON wholestage on 907 912 4 11.0 90.7 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc MONTH: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc MONTH wholestage off 923 928 7 10.8 92.3 1.0X
date_trunc MONTH wholestage on 902 911 9 11.1 90.2 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc MM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc MM wholestage off 922 924 3 10.8 92.2 1.0X
date_trunc MM wholestage on 908 914 7 11.0 90.8 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc DAY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc DAY wholestage off 644 665 30 15.5 64.4 1.0X
date_trunc DAY wholestage on 632 636 7 15.8 63.2 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc DD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc DD wholestage off 626 636 14 16.0 62.6 1.0X
date_trunc DD wholestage on 635 640 5 15.8 63.5 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc HOUR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc HOUR wholestage off 652 656 5 15.3 65.2 1.0X
date_trunc HOUR wholestage on 644 648 5 15.5 64.4 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc MINUTE: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc MINUTE wholestage off 617 618 2 16.2 61.7 1.0X
date_trunc MINUTE wholestage on 621 625 4 16.1 62.1 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc SECOND: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc SECOND wholestage off 631 631 0 15.8 63.1 1.0X
date_trunc SECOND wholestage on 625 630 8 16.0 62.5 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc WEEK: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc WEEK wholestage off 760 761 1 13.2 76.0 1.0X
date_trunc WEEK wholestage on 760 766 5 13.2 76.0 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc QUARTER: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc QUARTER wholestage off 1656 1657 1 6.0 165.6 1.0X
date_trunc QUARTER wholestage on 1648 1678 36 6.1 164.8 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc year: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc year wholestage off 309 309 1 32.4 30.9 1.0X
trunc year wholestage on 310 315 6 32.3 31.0 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc yyyy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc yyyy wholestage off 310 310 1 32.3 31.0 1.0X
trunc yyyy wholestage on 310 313 2 32.3 31.0 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc yy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc yy wholestage off 307 308 2 32.6 30.7 1.0X
trunc yy wholestage on 310 313 3 32.2 31.0 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc mon: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc mon wholestage off 308 317 12 32.5 30.8 1.0X
trunc mon wholestage on 309 316 7 32.3 30.9 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc month: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc month wholestage off 306 307 2 32.7 30.6 1.0X
trunc month wholestage on 309 314 6 32.4 30.9 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc mm: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc mm wholestage off 308 308 0 32.5 30.8 1.0X
trunc mm wholestage on 309 325 11 32.4 30.9 1.0X
================================================================================================
Parsing
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to timestamp str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to timestamp str wholestage off 170 170 1 5.9 170.0 1.0X
to timestamp str wholestage on 160 165 4 6.2 160.2 1.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to_timestamp wholestage off 1727 1730 4 0.6 1727.1 1.0X
to_timestamp wholestage on 1775 1793 19 0.6 1774.9 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to_unix_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to_unix_timestamp wholestage off 1760 1765 6 0.6 1760.4 1.0X
to_unix_timestamp wholestage on 1756 1763 9 0.6 1756.0 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to date str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to date str wholestage off 159 160 0 6.3 159.4 1.0X
to date str wholestage on 156 162 7 6.4 156.2 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to_date wholestage off 2509 2511 3 0.4 2509.2 1.0X
to_date wholestage on 2500 2514 9 0.4 2499.8 1.0X
================================================================================================
Conversion from/to external types
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
To/from java.sql.Timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
From java.sql.Timestamp 353 356 5 14.2 70.5 1.0X
Collect longs 1561 1864 476 3.2 312.2 0.2X
Collect timestamps 2010 2182 149 2.5 402.0 0.2X

642
sql/core/benchmarks/DateTimeBenchmark-results.txt
View file

@ -2,424 +2,428 @@
Extract components
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
cast to timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
cast to timestamp wholestage off 275 / 287 36.4 27.5 1.0X
cast to timestamp wholestage on 243 / 253 41.2 24.3 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
cast to timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to timestamp wholestage off 408 434 37 24.5 40.8 1.0X
cast to timestamp wholestage on 363 372 6 27.6 36.3 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
year of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
year of timestamp wholestage off 661 / 667 15.1 66.1 1.0X
year of timestamp wholestage on 659 / 669 15.2 65.9 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
year of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
year of timestamp wholestage off 1317 1327 14 7.6 131.7 1.0X
year of timestamp wholestage on 1258 1308 79 8.0 125.8 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
quarter of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
quarter of timestamp wholestage off 820 / 822 12.2 82.0 1.0X
quarter of timestamp wholestage on 768 / 776 13.0 76.8 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
quarter of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
quarter of timestamp wholestage off 1464 1490 37 6.8 146.4 1.0X
quarter of timestamp wholestage on 1389 1404 13 7.2 138.9 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
month of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
month of timestamp wholestage off 636 / 638 15.7 63.6 1.0X
month of timestamp wholestage on 648 / 654 15.4 64.8 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
month of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
month of timestamp wholestage off 1239 1245 7 8.1 123.9 1.0X
month of timestamp wholestage on 1241 1253 8 8.1 124.1 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
weekofyear of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
weekofyear of timestamp wholestage off 1093 / 1097 9.2 109.3 1.0X
weekofyear of timestamp wholestage on 1101 / 1107 9.1 110.1 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
weekofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
weekofyear of timestamp wholestage off 1896 1899 4 5.3 189.6 1.0X
weekofyear of timestamp wholestage on 1876 1885 6 5.3 187.6 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
day of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
day of timestamp wholestage off 643 / 644 15.6 64.3 1.0X
day of timestamp wholestage on 655 / 657 15.3 65.5 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
day of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
day of timestamp wholestage off 1234 1235 1 8.1 123.4 1.0X
day of timestamp wholestage on 1221 1231 8 8.2 122.1 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
dayofyear of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
dayofyear of timestamp wholestage off 681 / 692 14.7 68.1 1.0X
dayofyear of timestamp wholestage on 675 / 680 14.8 67.5 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
dayofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
dayofyear of timestamp wholestage off 1269 1275 8 7.9 126.9 1.0X
dayofyear of timestamp wholestage on 1266 1277 9 7.9 126.6 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
dayofmonth of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
dayofmonth of timestamp wholestage off 656 / 657 15.2 65.6 1.0X
dayofmonth of timestamp wholestage on 651 / 658 15.4 65.1 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
dayofmonth of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
dayofmonth of timestamp wholestage off 1236 1238 2 8.1 123.6 1.0X
dayofmonth of timestamp wholestage on 1223 1235 10 8.2 122.3 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
dayofweek of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
dayofweek of timestamp wholestage off 775 / 776 12.9 77.5 1.0X
dayofweek of timestamp wholestage on 777 / 781 12.9 77.7 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
dayofweek of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
dayofweek of timestamp wholestage off 1408 1409 2 7.1 140.8 1.0X
dayofweek of timestamp wholestage on 1393 1418 38 7.2 139.3 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
weekday of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
weekday of timestamp wholestage off 737 / 737 13.6 73.7 1.0X
weekday of timestamp wholestage on 737 / 739 13.6 73.7 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
weekday of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
weekday of timestamp wholestage off 1339 1348 12 7.5 133.9 1.0X
weekday of timestamp wholestage on 1329 1341 22 7.5 132.9 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
hour of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
hour of timestamp wholestage off 425 / 426 23.5 42.5 1.0X
hour of timestamp wholestage on 430 / 434 23.2 43.0 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
hour of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
hour of timestamp wholestage off 359 366 10 27.9 35.9 1.0X
hour of timestamp wholestage on 344 354 11 29.1 34.4 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
minute of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
minute of timestamp wholestage off 430 / 439 23.3 43.0 1.0X
minute of timestamp wholestage on 436 / 438 23.0 43.6 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
minute of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
minute of timestamp wholestage off 343 343 0 29.1 34.3 1.0X
minute of timestamp wholestage on 336 339 6 29.8 33.6 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
second of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
second of timestamp wholestage off 413 / 413 24.2 41.3 1.0X
second of timestamp wholestage on 413 / 425 24.2 41.3 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
second of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
second of timestamp wholestage off 367 383 23 27.2 36.7 1.0X
second of timestamp wholestage on 335 341 6 29.8 33.5 1.1X
================================================================================================
Current date and time
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
current_date: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
current_date wholestage off 205 / 206 48.7 20.5 1.0X
current_date wholestage on 219 / 224 45.8 21.9 0.9X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
current_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
current_date wholestage off 284 286 2 35.2 28.4 1.0X
current_date wholestage on 286 297 18 35.0 28.6 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
current_timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
current_timestamp wholestage off 212 / 213 47.3 21.2 1.0X
current_timestamp wholestage on 202 / 205 49.6 20.2 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
current_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
current_timestamp wholestage off 291 336 65 34.4 29.1 1.0X
current_timestamp wholestage on 279 290 11 35.9 27.9 1.0X
================================================================================================
Date arithmetic
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
cast to date: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
cast to date wholestage off 459 / 462 21.8 45.9 1.0X
cast to date wholestage on 493 / 500 20.3 49.3 0.9X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
cast to date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to date wholestage off 1069 1069 0 9.4 106.9 1.0X
cast to date wholestage on 1037 1043 7 9.6 103.7 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
last_day: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
last_day wholestage off 680 / 686 14.7 68.0 1.0X
last_day wholestage on 671 / 681 14.9 67.1 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
last_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
last_day wholestage off 1275 1287 18 7.8 127.5 1.0X
last_day wholestage on 1257 1267 10 8.0 125.7 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
next_day: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
next_day wholestage off 532 / 533 18.8 53.2 1.0X
next_day wholestage on 576 / 580 17.4 57.6 0.9X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
next_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
next_day wholestage off 1114 1116 2 9.0 111.4 1.0X
next_day wholestage on 1077 1081 7 9.3 107.7 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_add: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_add wholestage off 445 / 446 22.5 44.5 1.0X
date_add wholestage on 455 / 457 22.0 45.5 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_add: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_add wholestage off 1056 1058 2 9.5 105.6 1.0X
date_add wholestage on 1043 1047 3 9.6 104.3 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_sub: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_sub wholestage off 454 / 457 22.0 45.4 1.0X
date_sub wholestage on 455 / 458 22.0 45.5 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_sub: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_sub wholestage off 1045 1049 5 9.6 104.5 1.0X
date_sub wholestage on 1044 1052 16 9.6 104.4 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
add_months: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
add_months wholestage off 898 / 900 11.1 89.8 1.0X
add_months wholestage on 894 / 909 11.2 89.4 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
add_months: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
add_months wholestage off 1379 1384 7 7.3 137.9 1.0X
add_months wholestage on 1356 1364 6 7.4 135.6 1.0X
================================================================================================
Formatting dates
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
format date: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
format date wholestage off 4787 / 4839 2.1 478.7 1.0X
format date wholestage on 4736 / 4802 2.1 473.6 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
format date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
format date wholestage off 5436 5538 144 1.8 543.6 1.0X
format date wholestage on 5283 5295 16 1.9 528.3 1.0X
================================================================================================
Formatting timestamps
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
from_unixtime: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
from_unixtime wholestage off 7136 / 7163 1.4 713.6 1.0X
from_unixtime wholestage on 7144 / 7174 1.4 714.4 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
from_unixtime: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
from_unixtime wholestage off 8980 8998 26 1.1 898.0 1.0X
from_unixtime wholestage on 8921 8939 19 1.1 892.1 1.0X
================================================================================================
Convert timestamps
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
from_utc_timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
from_utc_timestamp wholestage off 880 / 888 11.4 88.0 1.0X
from_utc_timestamp wholestage on 841 / 854 11.9 84.1 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
from_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
from_utc_timestamp wholestage off 726 736 15 13.8 72.6 1.0X
from_utc_timestamp wholestage on 701 710 16 14.3 70.1 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
to_utc_timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
to_utc_timestamp wholestage off 879 / 884 11.4 87.9 1.0X
to_utc_timestamp wholestage on 862 / 876 11.6 86.2 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to_utc_timestamp wholestage off 1234 1240 8 8.1 123.4 1.0X
to_utc_timestamp wholestage on 757 770 15 13.2 75.7 1.6X
================================================================================================
Intervals
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
cast interval: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
cast interval wholestage off 242 / 250 41.3 24.2 1.0X
cast interval wholestage on 221 / 223 45.3 22.1 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
cast interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast interval wholestage off 327 328 2 30.6 32.7 1.0X
cast interval wholestage on 299 307 13 33.5 29.9 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
datediff: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
datediff wholestage off 697 / 698 14.3 69.7 1.0X
datediff wholestage on 680 / 683 14.7 68.0 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
datediff: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
datediff wholestage off 1865 1872 10 5.4 186.5 1.0X
datediff wholestage on 1815 1821 7 5.5 181.5 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
months_between: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
months_between wholestage off 1675 / 1677 6.0 167.5 1.0X
months_between wholestage on 1636 / 1649 6.1 163.6 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
months_between: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
months_between wholestage off 1524 1525 1 6.6 152.4 1.0X
months_between wholestage on 1511 1518 11 6.6 151.1 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
window: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
window wholestage off 1600 / 1627 0.6 1599.7 1.0X
window wholestage on 19480 / 19530 0.1 19479.6 0.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
window: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
window wholestage off 2441 2519 111 0.4 2440.7 1.0X
window wholestage on 46149 46165 16 0.0 46149.1 0.1X
================================================================================================
Truncation
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc YEAR: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc YEAR wholestage off 863 / 864 11.6 86.3 1.0X
date_trunc YEAR wholestage on 812 / 814 12.3 81.2 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc YEAR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc YEAR wholestage off 773 777 6 12.9 77.3 1.0X
date_trunc YEAR wholestage on 720 733 21 13.9 72.0 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc YYYY: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc YYYY wholestage off 865 / 926 11.6 86.5 1.0X
date_trunc YYYY wholestage on 811 / 820 12.3 81.1 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc YYYY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc YYYY wholestage off 753 754 1 13.3 75.3 1.0X
date_trunc YYYY wholestage on 721 725 3 13.9 72.1 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc YY: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc YY wholestage off 863 / 867 11.6 86.3 1.0X
date_trunc YY wholestage on 810 / 822 12.3 81.0 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc YY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc YY wholestage off 759 762 4 13.2 75.9 1.0X
date_trunc YY wholestage on 727 731 3 13.8 72.7 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc MON: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc MON wholestage off 917 / 921 10.9 91.7 1.0X
date_trunc MON wholestage on 857 / 860 11.7 85.7 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc MON: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc MON wholestage off 728 731 4 13.7 72.8 1.0X
date_trunc MON wholestage on 717 728 17 13.9 71.7 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc MONTH: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc MONTH wholestage off 919 / 919 10.9 91.9 1.0X
date_trunc MONTH wholestage on 862 / 863 11.6 86.2 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc MONTH: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc MONTH wholestage off 728 729 1 13.7 72.8 1.0X
date_trunc MONTH wholestage on 716 719 2 14.0 71.6 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc MM: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc MM wholestage off 923 / 924 10.8 92.3 1.0X
date_trunc MM wholestage on 855 / 859 11.7 85.5 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc MM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc MM wholestage off 725 732 9 13.8 72.5 1.0X
date_trunc MM wholestage on 721 728 6 13.9 72.1 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc DAY: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc DAY wholestage off 444 / 444 22.5 44.4 1.0X
date_trunc DAY wholestage on 404 / 406 24.7 40.4 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc DAY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc DAY wholestage off 515 520 7 19.4 51.5 1.0X
date_trunc DAY wholestage on 475 484 8 21.1 47.5 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc DD: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc DD wholestage off 445 / 446 22.5 44.5 1.0X
date_trunc DD wholestage on 404 / 406 24.7 40.4 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc DD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc DD wholestage off 515 520 7 19.4 51.5 1.0X
date_trunc DD wholestage on 471 484 9 21.2 47.1 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc HOUR: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc HOUR wholestage off 462 / 464 21.6 46.2 1.0X
date_trunc HOUR wholestage on 416 / 422 24.1 41.6 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc HOUR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc HOUR wholestage off 504 504 1 19.9 50.4 1.0X
date_trunc HOUR wholestage on 465 471 5 21.5 46.5 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc MINUTE: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc MINUTE wholestage off 294 / 294 34.0 29.4 1.0X
date_trunc MINUTE wholestage on 258 / 266 38.8 25.8 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc MINUTE: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc MINUTE wholestage off 485 488 4 20.6 48.5 1.0X
date_trunc MINUTE wholestage on 452 458 6 22.1 45.2 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc SECOND: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc SECOND wholestage off 292 / 295 34.2 29.2 1.0X
date_trunc SECOND wholestage on 271 / 276 36.9 27.1 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc SECOND: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc SECOND wholestage off 483 484 1 20.7 48.3 1.0X
date_trunc SECOND wholestage on 447 453 5 22.4 44.7 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc WEEK: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc WEEK wholestage off 739 / 740 13.5 73.9 1.0X
date_trunc WEEK wholestage on 712 / 715 14.0 71.2 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc WEEK: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc WEEK wholestage off 615 617 2 16.3 61.5 1.0X
date_trunc WEEK wholestage on 576 586 11 17.4 57.6 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
date_trunc QUARTER: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
date_trunc QUARTER wholestage off 1465 / 1467 6.8 146.5 1.0X
date_trunc QUARTER wholestage on 1419 / 1423 7.0 141.9 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
date_trunc QUARTER: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
date_trunc QUARTER wholestage off 1512 1513 1 6.6 151.2 1.0X
date_trunc QUARTER wholestage on 1482 1494 11 6.7 148.2 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
trunc year: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
trunc year wholestage off 222 / 222 45.0 22.2 1.0X
trunc year wholestage on 207 / 214 48.3 20.7 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc year: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc year wholestage off 342 343 1 29.2 34.2 1.0X
trunc year wholestage on 301 304 2 33.3 30.1 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
trunc yyyy: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
trunc yyyy wholestage off 221 / 225 45.2 22.1 1.0X
trunc yyyy wholestage on 208 / 212 48.0 20.8 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc yyyy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc yyyy wholestage off 321 323 2 31.1 32.1 1.0X
trunc yyyy wholestage on 303 305 2 33.0 30.3 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
trunc yy: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
trunc yy wholestage off 221 / 222 45.3 22.1 1.0X
trunc yy wholestage on 208 / 210 48.0 20.8 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc yy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc yy wholestage off 314 325 15 31.8 31.4 1.0X
trunc yy wholestage on 299 307 10 33.4 29.9 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
trunc mon: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
trunc mon wholestage off 231 / 239 43.3 23.1 1.0X
trunc mon wholestage on 208 / 214 48.0 20.8 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc mon: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc mon wholestage off 311 312 2 32.2 31.1 1.0X
trunc mon wholestage on 300 307 6 33.3 30.0 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
trunc month: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
trunc month wholestage off 222 / 222 45.1 22.2 1.0X
trunc month wholestage on 208 / 224 48.1 20.8 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc month: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc month wholestage off 312 314 2 32.1 31.2 1.0X
trunc month wholestage on 299 300 1 33.5 29.9 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
trunc mm: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
trunc mm wholestage off 222 / 226 45.1 22.2 1.0X
trunc mm wholestage on 208 / 216 48.0 20.8 1.1X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
trunc mm: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
trunc mm wholestage off 308 316 11 32.5 30.8 1.0X
trunc mm wholestage on 298 301 2 33.6 29.8 1.0X
================================================================================================
Parsing
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
to timestamp str: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
to timestamp str wholestage off 165 / 166 6.1 164.7 1.0X
to timestamp str wholestage on 160 / 163 6.2 160.5 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to timestamp str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to timestamp str wholestage off 228 232 5 4.4 228.3 1.0X
to timestamp str wholestage on 213 214 2 4.7 212.9 1.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to_timestamp wholestage off 1308 1353 64 0.8 1307.9 1.0X
to_timestamp wholestage on 1197 1230 21 0.8 1197.0 1.1X
to_timestamp wholestage off 1850 1850 0 0.5 1850.0 1.0X
to_timestamp wholestage on 1877 1899 27 0.5 1876.8 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to_unix_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to_unix_timestamp wholestage off 1221 1224 4 0.8 1221.0 1.0X
to_unix_timestamp wholestage on 1224 1228 4 0.8 1223.8 1.0X
to_unix_timestamp wholestage off 1883 1886 4 0.5 1882.7 1.0X
to_unix_timestamp wholestage on 1817 1831 17 0.6 1817.3 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
to date str: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
to date str wholestage off 155 / 157 6.4 155.4 1.0X
to date str wholestage on 154 / 156 6.5 154.3 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to date str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to date str wholestage off 212 212 1 4.7 211.8 1.0X
to date str wholestage on 206 208 2 4.8 206.3 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
to_date: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
to_date wholestage off 1477 / 1479 0.7 1477.3 1.0X
to_date wholestage on 1468 / 1473 0.7 1468.2 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
to_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
to_date wholestage off 2334 2335 0 0.4 2334.3 1.0X
to_date wholestage on 2224 2236 13 0.4 2224.2 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
================================================================================================
Conversion from/to external types
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
To/from java.sql.Timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
From java.sql.Timestamp 283 301 19 17.7 56.6 1.0X
Collect longs 1048 1087 36 4.8 209.6 0.3X
Collect timestamps 1425 1479 56 3.5 285.1 0.2X
From java.sql.Timestamp 271 274 3 18.4 54.2 1.0X
Collect longs 1386 1925 681 3.6 277.1 0.2X
Collect timestamps 1961 2169 331 2.5 392.2 0.1X

45
sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,45 @@
================================================================================================
WITHOUT SPILL
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Array with 100000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ArrayBuffer 5371 5392 30 19.1 52.5 1.0X
ExternalAppendOnlyUnsafeRowArray 6724 6778 77 15.2 65.7 0.8X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Array with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ArrayBuffer 9120 9121 1 28.7 34.8 1.0X
ExternalAppendOnlyUnsafeRowArray 37713 37739 38 7.0 143.9 0.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Array with 30000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ArrayBuffer 18037 18052 21 27.3 36.7 1.0X
ExternalAppendOnlyUnsafeRowArray 34726 34771 63 14.2 70.7 0.5X
================================================================================================
WITH SPILL
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Spilling with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
UnsafeExternalSorter 29668 29676 11 8.8 113.2 1.0X
ExternalAppendOnlyUnsafeRowArray 12658 12663 6 20.7 48.3 2.3X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Spilling with 10000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
UnsafeExternalSorter 12 12 0 13.8 72.7 1.0X
ExternalAppendOnlyUnsafeRowArray 8 8 0 19.8 50.6 1.4X

50
sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-results.txt
View file

@ -2,44 +2,44 @@
WITHOUT SPILL
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Array with 100000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
ArrayBuffer 6378 / 6550 16.1 62.3 1.0X
ExternalAppendOnlyUnsafeRowArray 6196 / 6242 16.5 60.5 1.0X
Array with 100000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ArrayBuffer 7626 7776 212 13.4 74.5 1.0X
ExternalAppendOnlyUnsafeRowArray 8432 8498 93 12.1 82.3 0.9X
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Array with 1000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
ArrayBuffer 11988 / 12027 21.9 45.7 1.0X
ExternalAppendOnlyUnsafeRowArray 37480 / 37574 7.0 143.0 0.3X
Array with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ArrayBuffer 11753 11763 15 22.3 44.8 1.0X
ExternalAppendOnlyUnsafeRowArray 38921 39236 446 6.7 148.5 0.3X
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Array with 30000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
ArrayBuffer 23536 / 23538 20.9 47.9 1.0X
ExternalAppendOnlyUnsafeRowArray 31275 / 31277 15.7 63.6 0.8X
Array with 30000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
ArrayBuffer 23820 23829 12 20.6 48.5 1.0X
ExternalAppendOnlyUnsafeRowArray 33449 33466 25 14.7 68.1 0.7X
================================================================================================
WITH SPILL
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Spilling with 1000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
UnsafeExternalSorter 29241 / 29279 9.0 111.5 1.0X
ExternalAppendOnlyUnsafeRowArray 14309 / 14313 18.3 54.6 2.0X
Spilling with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
UnsafeExternalSorter 31384 31479 135 8.4 119.7 1.0X
ExternalAppendOnlyUnsafeRowArray 15278 15303 35 17.2 58.3 2.1X
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Spilling with 10000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
UnsafeExternalSorter 11 / 11 14.8 67.4 1.0X
ExternalAppendOnlyUnsafeRowArray 9 / 9 17.6 56.8 1.2X
Spilling with 10000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
UnsafeExternalSorter 11 11 1 14.7 68.0 1.0X
ExternalAppendOnlyUnsafeRowArray 9 10 1 17.1 58.5 1.2X

160
sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt
View file

@ -2,99 +2,99 @@ OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to timestamp 438 548 128 22.8 43.8 1.0X
MILLENNIUM of timestamp 1343 1453 139 7.4 134.3 0.3X
CENTURY of timestamp 1287 1305 16 7.8 128.7 0.3X
DECADE of timestamp 1253 1258 7 8.0 125.3 0.3X
YEAR of timestamp 1224 1247 24 8.2 122.4 0.4X
ISOYEAR of timestamp 1356 1383 35 7.4 135.6 0.3X
QUARTER of timestamp 1386 1395 8 7.2 138.6 0.3X
MONTH of timestamp 1215 1227 11 8.2 121.5 0.4X
WEEK of timestamp 1711 1720 9 5.8 171.1 0.3X
DAY of timestamp 1227 1251 37 8.1 122.7 0.4X
DAYOFWEEK of timestamp 1386 1392 11 7.2 138.6 0.3X
DOW of timestamp 1405 1426 34 7.1 140.5 0.3X
ISODOW of timestamp 1344 1363 30 7.4 134.4 0.3X
DOY of timestamp 1249 1251 3 8.0 124.9 0.4X
HOUR of timestamp 766 773 9 13.1 76.6 0.6X
MINUTE of timestamp 761 774 22 13.1 76.1 0.6X
SECOND of timestamp 627 638 11 16.0 62.7 0.7X
MILLISECONDS of timestamp 700 704 4 14.3 70.0 0.6X
MICROSECONDS of timestamp 615 627 10 16.3 61.5 0.7X
EPOCH of timestamp 28897 28929 29 0.3 2889.7 0.0X
cast to timestamp 342 456 120 29.2 34.2 1.0X
MILLENNIUM of timestamp 1462 1498 53 6.8 146.2 0.2X
CENTURY of timestamp 1229 1293 86 8.1 122.9 0.3X
DECADE of timestamp 1204 1242 56 8.3 120.4 0.3X
YEAR of timestamp 1180 1226 72 8.5 118.0 0.3X
ISOYEAR of timestamp 1279 1301 33 7.8 127.9 0.3X
QUARTER of timestamp 1357 1379 22 7.4 135.7 0.3X
MONTH of timestamp 1155 1182 24 8.7 115.5 0.3X
WEEK of timestamp 1634 1641 10 6.1 163.4 0.2X
DAY of timestamp 1167 1171 6 8.6 116.7 0.3X
DAYOFWEEK of timestamp 1335 1344 8 7.5 133.5 0.3X
DOW of timestamp 1344 1352 11 7.4 134.4 0.3X
ISODOW of timestamp 1279 1281 2 7.8 127.9 0.3X
DOY of timestamp 1172 1183 16 8.5 117.2 0.3X
HOUR of timestamp 722 731 12 13.8 72.2 0.5X
MINUTE of timestamp 725 734 9 13.8 72.5 0.5X
SECOND of timestamp 656 661 6 15.3 65.6 0.5X
MILLISECONDS of timestamp 630 637 9 15.9 63.0 0.5X
MICROSECONDS of timestamp 587 592 7 17.0 58.7 0.6X
EPOCH of timestamp 1036 1047 13 9.7 103.6 0.3X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to date 1078 1081 4 9.3 107.8 1.0X
MILLENNIUM of date 1232 1244 16 8.1 123.2 0.9X
CENTURY of date 1233 1234 1 8.1 123.3 0.9X
DECADE of date 1210 1212 3 8.3 121.0 0.9X
YEAR of date 1201 1212 9 8.3 120.1 0.9X
ISOYEAR of date 1468 1474 5 6.8 146.8 0.7X
QUARTER of date 1474 1482 11 6.8 147.4 0.7X
MONTH of date 1211 1215 4 8.3 121.1 0.9X
WEEK of date 1684 1685 2 5.9 168.4 0.6X
DAY of date 1208 1214 6 8.3 120.8 0.9X
DAYOFWEEK of date 1374 1387 23 7.3 137.4 0.8X
DOW of date 1396 1404 11 7.2 139.6 0.8X
ISODOW of date 1320 1322 3 7.6 132.0 0.8X
DOY of date 1243 1258 13 8.0 124.3 0.9X
HOUR of date 1997 2018 29 5.0 199.7 0.5X
MINUTE of date 2021 2039 26 4.9 202.1 0.5X
SECOND of date 1862 1878 22 5.4 186.2 0.6X
MILLISECONDS of date 1998 2015 16 5.0 199.8 0.5X
MICROSECONDS of date 1893 1901 7 5.3 189.3 0.6X
EPOCH of date 30353 30376 41 0.3 3035.3 0.0X
cast to date 1044 1081 63 9.6 104.4 1.0X
MILLENNIUM of date 1367 1375 10 7.3 136.7 0.8X
CENTURY of date 1181 1183 3 8.5 118.1 0.9X
DECADE of date 1154 1163 8 8.7 115.4 0.9X
YEAR of date 1138 1154 16 8.8 113.8 0.9X
ISOYEAR of date 1394 1401 8 7.2 139.4 0.7X
QUARTER of date 1336 1362 26 7.5 133.6 0.8X
MONTH of date 1137 1144 11 8.8 113.7 0.9X
WEEK of date 1619 1632 18 6.2 161.9 0.6X
DAY of date 1144 1158 22 8.7 114.4 0.9X
DAYOFWEEK of date 1328 1330 2 7.5 132.8 0.8X
DOW of date 1336 1339 4 7.5 133.6 0.8X
ISODOW of date 1272 1276 3 7.9 127.2 0.8X
DOY of date 1170 1174 4 8.6 117.0 0.9X
HOUR of date 1963 1986 35 5.1 196.3 0.5X
MINUTE of date 1969 1984 19 5.1 196.9 0.5X
SECOND of date 1926 1929 3 5.2 192.6 0.5X
MILLISECONDS of date 1928 1939 16 5.2 192.8 0.5X
MICROSECONDS of date 1816 1821 4 5.5 181.6 0.6X
EPOCH of date 2331 2336 4 4.3 233.1 0.4X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to timestamp 384 389 4 26.1 38.4 1.0X
MILLENNIUM of timestamp 1237 1244 6 8.1 123.7 0.3X
CENTURY of timestamp 1236 1244 7 8.1 123.6 0.3X
DECADE of timestamp 1204 1210 9 8.3 120.4 0.3X
YEAR of timestamp 1197 1207 16 8.4 119.7 0.3X
ISOYEAR of timestamp 1466 1470 4 6.8 146.6 0.3X
QUARTER of timestamp 1500 1505 6 6.7 150.0 0.3X
MONTH of timestamp 1190 1218 25 8.4 119.0 0.3X
WEEK of timestamp 1681 1710 25 5.9 168.1 0.2X
DAY of timestamp 1201 1206 7 8.3 120.1 0.3X
DAYOFWEEK of timestamp 1376 1390 13 7.3 137.6 0.3X
DOW of timestamp 1399 1409 17 7.1 139.9 0.3X
ISODOW of timestamp 1347 1354 8 7.4 134.7 0.3X
DOY of timestamp 1257 1263 6 8.0 125.7 0.3X
HOUR of timestamp 749 753 5 13.4 74.9 0.5X
MINUTE of timestamp 746 749 4 13.4 74.6 0.5X
SECOND of timestamp 626 637 15 16.0 62.6 0.6X
MILLISECONDS of timestamp 695 724 25 14.4 69.5 0.6X
MICROSECONDS of timestamp 611 629 27 16.4 61.1 0.6X
EPOCH of timestamp 28908 28938 31 0.3 2890.8 0.0X
cast to timestamp 315 320 8 31.8 31.5 1.0X
MILLENNIUM of timestamp 1365 1369 4 7.3 136.5 0.2X
CENTURY of timestamp 1176 1179 4 8.5 117.6 0.3X
DECADE of timestamp 1153 1168 14 8.7 115.3 0.3X
YEAR of timestamp 1131 1135 5 8.8 113.1 0.3X
ISOYEAR of timestamp 1388 1397 8 7.2 138.8 0.2X
QUARTER of timestamp 1344 1363 25 7.4 134.4 0.2X
MONTH of timestamp 1135 1141 6 8.8 113.5 0.3X
WEEK of timestamp 1612 1615 5 6.2 161.2 0.2X
DAY of timestamp 1138 1145 7 8.8 113.8 0.3X
DAYOFWEEK of timestamp 1322 1330 7 7.6 132.2 0.2X
DOW of timestamp 1317 1323 5 7.6 131.7 0.2X
ISODOW of timestamp 1284 1287 4 7.8 128.4 0.2X
DOY of timestamp 1163 1172 11 8.6 116.3 0.3X
HOUR of timestamp 709 709 1 14.1 70.9 0.4X
MINUTE of timestamp 713 714 1 14.0 71.3 0.4X
SECOND of timestamp 635 641 6 15.7 63.5 0.5X
MILLISECONDS of timestamp 625 629 7 16.0 62.5 0.5X
MICROSECONDS of timestamp 572 573 2 17.5 57.2 0.6X
EPOCH of timestamp 1031 1033 3 9.7 103.1 0.3X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to date 1076 1083 6 9.3 107.6 1.0X
MILLENNIUM of date 1230 1236 7 8.1 123.0 0.9X
CENTURY of date 1245 1250 5 8.0 124.5 0.9X
DECADE of date 1206 1211 8 8.3 120.6 0.9X
YEAR of date 1194 1201 6 8.4 119.4 0.9X
ISOYEAR of date 1461 1471 9 6.8 146.1 0.7X
QUARTER of date 1496 1500 7 6.7 149.6 0.7X
MONTH of date 1192 1195 4 8.4 119.2 0.9X
WEEK of date 1682 1687 6 5.9 168.2 0.6X
DAY of date 1199 1207 14 8.3 119.9 0.9X
DAYOFWEEK of date 1372 1383 19 7.3 137.2 0.8X
DOW of date 1384 1393 14 7.2 138.4 0.8X
ISODOW of date 1327 1338 10 7.5 132.7 0.8X
DOY of date 1243 1247 7 8.0 124.3 0.9X
HOUR of date 2001 2010 10 5.0 200.1 0.5X
MINUTE of date 2046 2053 9 4.9 204.6 0.5X
SECOND of date 1859 1863 4 5.4 185.9 0.6X
MILLISECONDS of date 2000 2013 16 5.0 200.0 0.5X
MICROSECONDS of date 1856 1857 1 5.4 185.6 0.6X
EPOCH of date 30365 30388 29 0.3 3036.5 0.0X
cast to date 994 998 3 10.1 99.4 1.0X
MILLENNIUM of date 1361 1371 9 7.3 136.1 0.7X
CENTURY of date 1171 1180 15 8.5 117.1 0.8X
DECADE of date 1149 1153 4 8.7 114.9 0.9X
YEAR of date 1128 1130 2 8.9 112.8 0.9X
ISOYEAR of date 1384 1398 19 7.2 138.4 0.7X
QUARTER of date 1333 1345 19 7.5 133.3 0.7X
MONTH of date 1132 1138 7 8.8 113.2 0.9X
WEEK of date 1616 1624 9 6.2 161.6 0.6X
DAY of date 1132 1135 3 8.8 113.2 0.9X
DAYOFWEEK of date 1320 1322 3 7.6 132.0 0.8X
DOW of date 1317 1319 2 7.6 131.7 0.8X
ISODOW of date 1269 1272 5 7.9 126.9 0.8X
DOY of date 1171 1190 17 8.5 117.1 0.8X
HOUR of date 1960 1962 2 5.1 196.0 0.5X
MINUTE of date 1974 1975 1 5.1 197.4 0.5X
SECOND of date 1915 1922 8 5.2 191.5 0.5X
MILLISECONDS of date 1923 1924 2 5.2 192.3 0.5X
MICROSECONDS of date 1817 1819 1 5.5 181.7 0.5X
EPOCH of date 2323 2326 2 4.3 232.3 0.4X

176
sql/core/benchmarks/ExtractBenchmark-results.txt
View file

@ -1,100 +1,100 @@
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to timestamp 255 307 48 39.2 25.5 1.0X
MILLENNIUM of timestamp 1269 1316 64 7.9 126.9 0.2X
CENTURY of timestamp 1157 1188 33 8.6 115.7 0.2X
DECADE of timestamp 1067 1122 52 9.4 106.7 0.2X
YEAR of timestamp 1099 1163 76 9.1 109.9 0.2X
ISOYEAR of timestamp 1133 1181 43 8.8 113.3 0.2X
QUARTER of timestamp 1192 1222 28 8.4 119.2 0.2X
MONTH of timestamp 1035 1057 38 9.7 103.5 0.2X
WEEK of timestamp 1519 1570 61 6.6 151.9 0.2X
DAY of timestamp 1020 1046 37 9.8 102.0 0.3X
DAYOFWEEK of timestamp 1159 1194 41 8.6 115.9 0.2X
DOW of timestamp 1151 1163 17 8.7 115.1 0.2X
ISODOW of timestamp 1099 1117 26 9.1 109.9 0.2X
DOY of timestamp 1050 1067 27 9.5 105.0 0.2X
HOUR of timestamp 442 449 6 22.6 44.2 0.6X
MINUTE of timestamp 434 437 4 23.1 43.4 0.6X
SECOND of timestamp 606 612 5 16.5 60.6 0.4X
MILLISECONDS of timestamp 627 629 3 15.9 62.7 0.4X
MICROSECONDS of timestamp 528 530 2 18.9 52.8 0.5X
EPOCH of timestamp 998 1001 3 10.0 99.8 0.3X
cast to timestamp 404 460 71 24.8 40.4 1.0X
MILLENNIUM of timestamp 1432 1580 128 7.0 143.2 0.3X
CENTURY of timestamp 1380 1390 10 7.2 138.0 0.3X
DECADE of timestamp 1254 1261 8 8.0 125.4 0.3X
YEAR of timestamp 1229 1236 9 8.1 122.9 0.3X
ISOYEAR of timestamp 1382 1415 44 7.2 138.2 0.3X
QUARTER of timestamp 1444 1458 16 6.9 144.4 0.3X
MONTH of timestamp 1212 1257 60 8.2 121.2 0.3X
WEEK of timestamp 1718 1730 12 5.8 171.8 0.2X
DAY of timestamp 1180 1201 22 8.5 118.0 0.3X
DAYOFWEEK of timestamp 1371 1427 68 7.3 137.1 0.3X
DOW of timestamp 1365 1378 18 7.3 136.5 0.3X
ISODOW of timestamp 1312 1319 7 7.6 131.2 0.3X
DOY of timestamp 1224 1238 16 8.2 122.4 0.3X
HOUR of timestamp 343 355 16 29.2 34.3 1.2X
MINUTE of timestamp 341 344 3 29.3 34.1 1.2X
SECOND of timestamp 553 556 2 18.1 55.3 0.7X
MILLISECONDS of timestamp 562 565 3 17.8 56.2 0.7X
MICROSECONDS of timestamp 435 465 49 23.0 43.5 0.9X
EPOCH of timestamp 1211 1217 9 8.3 121.1 0.3X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to date 859 862 3 11.6 85.9 1.0X
MILLENNIUM of date 1097 1097 1 9.1 109.7 0.8X
CENTURY of date 1100 1105 6 9.1 110.0 0.8X
DECADE of date 1030 1032 1 9.7 103.0 0.8X
YEAR of date 1011 1014 3 9.9 101.1 0.8X
ISOYEAR of date 1228 1242 20 8.1 122.8 0.7X
QUARTER of date 1241 1259 17 8.1 124.1 0.7X
MONTH of date 1016 1018 2 9.8 101.6 0.8X
WEEK of date 1485 1496 9 6.7 148.5 0.6X
DAY of date 1019 1027 11 9.8 101.9 0.8X
DAYOFWEEK of date 1131 1142 10 8.8 113.1 0.8X
DOW of date 1125 1132 7 8.9 112.5 0.8X
ISODOW of date 1087 1089 2 9.2 108.7 0.8X
DOY of date 1053 1057 3 9.5 105.3 0.8X
HOUR of date 1768 1773 5 5.7 176.8 0.5X
MINUTE of date 1764 1771 9 5.7 176.4 0.5X
SECOND of date 1960 1964 4 5.1 196.0 0.4X
MILLISECONDS of date 1967 1971 4 5.1 196.7 0.4X
MICROSECONDS of date 1852 1859 6 5.4 185.2 0.5X
EPOCH of date 2387 2390 4 4.2 238.7 0.4X
cast to date 1030 1038 8 9.7 103.0 1.0X
MILLENNIUM of date 1302 1306 6 7.7 130.2 0.8X
CENTURY of date 1309 1315 6 7.6 130.9 0.8X
DECADE of date 1197 1202 7 8.4 119.7 0.9X
YEAR of date 1182 1192 10 8.5 118.2 0.9X
ISOYEAR of date 1421 1429 10 7.0 142.1 0.7X
QUARTER of date 1454 1468 14 6.9 145.4 0.7X
MONTH of date 1217 1230 19 8.2 121.7 0.8X
WEEK of date 1723 1725 3 5.8 172.3 0.6X
DAY of date 1188 1191 4 8.4 118.8 0.9X
DAYOFWEEK of date 1348 1355 6 7.4 134.8 0.8X
DOW of date 1344 1353 8 7.4 134.4 0.8X
ISODOW of date 1301 1311 9 7.7 130.1 0.8X
DOY of date 1237 1241 4 8.1 123.7 0.8X
HOUR of date 1465 1474 16 6.8 146.5 0.7X
MINUTE of date 1463 1471 8 6.8 146.3 0.7X
SECOND of date 1720 1725 5 5.8 172.0 0.6X
MILLISECONDS of date 1739 1749 9 5.8 173.9 0.6X
MICROSECONDS of date 1607 1611 4 6.2 160.7 0.6X
EPOCH of date 2370 2377 10 4.2 237.0 0.4X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to timestamp 242 248 10 41.3 24.2 1.0X
MILLENNIUM of timestamp 1121 1128 9 8.9 112.1 0.2X
CENTURY of timestamp 1104 1109 7 9.1 110.4 0.2X
DECADE of timestamp 1023 1026 3 9.8 102.3 0.2X
YEAR of timestamp 1009 1011 2 9.9 100.9 0.2X
ISOYEAR of timestamp 1225 1228 4 8.2 122.5 0.2X
QUARTER of timestamp 1222 1226 3 8.2 122.2 0.2X
MONTH of timestamp 1017 1018 1 9.8 101.7 0.2X
WEEK of timestamp 1480 1485 5 6.8 148.0 0.2X
DAY of timestamp 1010 1012 2 9.9 101.0 0.2X
DAYOFWEEK of timestamp 1124 1128 3 8.9 112.4 0.2X
DOW of timestamp 1119 1121 3 8.9 111.9 0.2X
ISODOW of timestamp 1085 1087 4 9.2 108.5 0.2X
DOY of timestamp 1040 1054 12 9.6 104.0 0.2X
HOUR of timestamp 433 435 2 23.1 43.3 0.6X
MINUTE of timestamp 430 431 2 23.3 43.0 0.6X
SECOND of timestamp 600 603 3 16.7 60.0 0.4X
MILLISECONDS of timestamp 618 623 5 16.2 61.8 0.4X
MICROSECONDS of timestamp 521 524 3 19.2 52.1 0.5X
EPOCH of timestamp 987 989 2 10.1 98.7 0.2X
cast to timestamp 307 312 6 32.6 30.7 1.0X
MILLENNIUM of timestamp 1294 1298 4 7.7 129.4 0.2X
CENTURY of timestamp 1317 1321 6 7.6 131.7 0.2X
DECADE of timestamp 1202 1207 8 8.3 120.2 0.3X
YEAR of timestamp 1196 1201 8 8.4 119.6 0.3X
ISOYEAR of timestamp 1431 1440 10 7.0 143.1 0.2X
QUARTER of timestamp 1483 1487 5 6.7 148.3 0.2X
MONTH of timestamp 1205 1209 4 8.3 120.5 0.3X
WEEK of timestamp 1728 1731 4 5.8 172.8 0.2X
DAY of timestamp 1190 1193 3 8.4 119.0 0.3X
DAYOFWEEK of timestamp 1369 1371 2 7.3 136.9 0.2X
DOW of timestamp 1371 1373 3 7.3 137.1 0.2X
ISODOW of timestamp 1316 1321 8 7.6 131.6 0.2X
DOY of timestamp 1236 1241 6 8.1 123.6 0.2X
HOUR of timestamp 342 343 1 29.3 34.2 0.9X
MINUTE of timestamp 338 352 23 29.6 33.8 0.9X
SECOND of timestamp 555 556 1 18.0 55.5 0.6X
MILLISECONDS of timestamp 570 573 4 17.6 57.0 0.5X
MICROSECONDS of timestamp 436 442 5 22.9 43.6 0.7X
EPOCH of timestamp 1212 1218 7 8.3 121.2 0.3X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cast to date 856 865 8 11.7 85.6 1.0X
MILLENNIUM of date 1096 1098 3 9.1 109.6 0.8X
CENTURY of date 1095 1099 4 9.1 109.5 0.8X
DECADE of date 1023 1028 6 9.8 102.3 0.8X
YEAR of date 1006 1011 5 9.9 100.6 0.9X
ISOYEAR of date 1201 1212 14 8.3 120.1 0.7X
QUARTER of date 1224 1228 4 8.2 122.4 0.7X
MONTH of date 1009 1011 2 9.9 100.9 0.8X
WEEK of date 1478 1485 7 6.8 147.8 0.6X
DAY of date 1006 1008 3 9.9 100.6 0.9X
DAYOFWEEK of date 1131 1133 2 8.8 113.1 0.8X
DOW of date 1119 1121 2 8.9 111.9 0.8X
ISODOW of date 1083 1085 3 9.2 108.3 0.8X
DOY of date 1035 1051 25 9.7 103.5 0.8X
HOUR of date 1764 1779 22 5.7 176.4 0.5X
MINUTE of date 1763 1766 2 5.7 176.3 0.5X
SECOND of date 1957 1965 10 5.1 195.7 0.4X
MILLISECONDS of date 1960 1961 2 5.1 196.0 0.4X
MICROSECONDS of date 1852 1854 2 5.4 185.2 0.5X
EPOCH of date 2381 2383 3 4.2 238.1 0.4X
cast to date 1017 1025 13 9.8 101.7 1.0X
MILLENNIUM of date 1314 1318 5 7.6 131.4 0.8X
CENTURY of date 1318 1334 16 7.6 131.8 0.8X
DECADE of date 1205 1210 5 8.3 120.5 0.8X
YEAR of date 1187 1190 3 8.4 118.7 0.9X
ISOYEAR of date 1409 1432 21 7.1 140.9 0.7X
QUARTER of date 1477 1482 6 6.8 147.7 0.7X
MONTH of date 1193 1199 7 8.4 119.3 0.9X
WEEK of date 1711 1719 7 5.8 171.1 0.6X
DAY of date 1183 1192 7 8.5 118.3 0.9X
DAYOFWEEK of date 1368 1371 6 7.3 136.8 0.7X
DOW of date 1361 1366 8 7.3 136.1 0.7X
ISODOW of date 1312 1315 3 7.6 131.2 0.8X
DOY of date 1230 1233 2 8.1 123.0 0.8X
HOUR of date 1480 1483 2 6.8 148.0 0.7X
MINUTE of date 1473 1489 27 6.8 147.3 0.7X
SECOND of date 1731 1737 7 5.8 173.1 0.6X
MILLISECONDS of date 1744 1749 6 5.7 174.4 0.6X
MICROSECONDS of date 1592 1594 1 6.3 159.2 0.6X
EPOCH of date 2368 2371 3 4.2 236.8 0.4X

11
sql/core/benchmarks/HashedRelationMetricsBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,11 @@
================================================================================================
LongToUnsafeRowMap metrics
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LongToUnsafeRowMap metrics: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
LongToUnsafeRowMap 568 575 5 0.9 1136.4 1.0X

10
sql/core/benchmarks/HashedRelationMetricsBenchmark-results.txt
View file

@ -2,10 +2,10 @@
LongToUnsafeRowMap metrics
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_181-b13 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-7700HQ CPU @ 2.80GHz
LongToUnsafeRowMap metrics: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
LongToUnsafeRowMap 234 / 315 2.1 467.3 1.0X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
LongToUnsafeRowMap metrics: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
LongToUnsafeRowMap 513 629 106 1.0 1026.6 1.0X

112
sql/core/benchmarks/JSONBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,112 @@
================================================================================================
Benchmark for performance of JSON parsing
================================================================================================
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 70863 71147 417 1.4 708.6 1.0X
UTF-8 is set 133520 133658 131 0.7 1335.2 0.5X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 44462 44655 313 2.2 444.6 1.0X
UTF-8 is set 89342 89386 53 1.1 893.4 0.5X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 58617 59071 541 0.2 5861.7 1.0X
UTF-8 is set 102650 102948 493 0.1 10265.0 0.6X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 168197 168256 61 0.0 336393.0 1.0X
UTF-8 is set 191539 191724 186 0.0 383078.2 0.9X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Select 10 columns 18983 18998 22 0.5 1898.3 1.0X
Select 1 column 23544 23575 32 0.4 2354.4 0.8X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Short column without encoding 9336 9402 66 1.1 933.6 1.0X
Short column with UTF-8 13310 13870 489 0.8 1331.0 0.7X
Wide column without encoding 112821 113012 202 0.1 11282.1 0.1X
Wide column with UTF-8 156408 156910 776 0.1 15640.8 0.1X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Text read 743 744 1 13.5 74.3 1.0X
from_json 22379 22566 279 0.4 2237.9 0.0X
json_tuple 32201 32271 89 0.3 3220.1 0.0X
get_json_object 21973 22405 375 0.5 2197.3 0.0X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Text read 3771 3780 8 13.3 75.4 1.0X
schema inferring 34808 35213 506 1.4 696.2 0.1X
parsing 36917 38889 1757 1.4 738.3 0.1X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Text read 11928 11955 38 4.2 238.6 1.0X
Schema inferring 44716 44921 220 1.1 894.3 0.3X
Parsing without charset 35749 35838 77 1.4 715.0 0.3X
Parsing with UTF-8 50521 50530 12 1.0 1010.4 0.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Create a dataset of timestamps 2473 2487 18 4.0 247.3 1.0X
to_json(timestamp) 16100 16284 236 0.6 1610.0 0.2X
write timestamps to files 13226 13852 676 0.8 1322.6 0.2X
Create a dataset of dates 2661 2680 16 3.8 266.1 0.9X
to_json(date) 10696 10730 55 0.9 1069.6 0.2X
write dates to files 8543 8926 384 1.2 854.3 0.3X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
read timestamp text from files 2822 2829 8 3.5 282.2 1.0X
read timestamps from files 34884 34900 23 0.3 3488.4 0.1X
infer timestamps from files 70310 71551 1079 0.1 7031.0 0.0X
read date text from files 2649 2655 6 3.8 264.9 1.1X
read date from files 22875 22904 33 0.4 2287.5 0.1X
timestamp strings 4025 4059 31 2.5 402.5 0.7X
parse timestamps from Dataset[String] 43040 43157 115 0.2 4304.0 0.1X
infer timestamps from Dataset[String] 81762 81927 144 0.1 8176.2 0.0X
date strings 4899 4913 21 2.0 489.9 0.6X
parse dates from Dataset[String] 33530 33560 27 0.3 3353.0 0.1X
from_json(timestamp) 60762 60877 142 0.2 6076.2 0.0X
from_json(date) 52482 52620 150 0.2 5248.2 0.1X

130
sql/core/benchmarks/JSONBenchmark-results.txt
View file

@ -3,110 +3,110 @@ Benchmark for performance of JSON parsing
================================================================================================
Preparing data for benchmarking ...
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 50949 51086 150 2.0 509.5 1.0X
UTF-8 is set 72012 72147 120 1.4 720.1 0.7X
No encoding 69387 69850 407 1.4 693.9 1.0X
UTF-8 is set 112131 112205 83 0.9 1121.3 0.6X
Preparing data for benchmarking ...
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 36799 36891 80 2.7 368.0 1.0X
UTF-8 is set 59796 59880 74 1.7 598.0 0.6X
No encoding 44542 44671 122 2.2 445.4 1.0X
UTF-8 is set 71793 71945 146 1.4 717.9 0.6X
Preparing data for benchmarking ...
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 55803 55967 152 0.2 5580.3 1.0X
UTF-8 is set 80623 80825 178 0.1 8062.3 0.7X
No encoding 58615 59011 347 0.2 5861.5 1.0X
UTF-8 is set 102542 102719 153 0.1 10254.2 0.6X
Preparing data for benchmarking ...
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 84263 85750 1476 0.0 168526.2 1.0X
UTF-8 is set 98848 100183 1592 0.0 197696.0 0.9X
No encoding 168861 170014 1552 0.0 337722.0 1.0X
UTF-8 is set 191140 191250 112 0.0 382280.3 0.9X
Preparing data for benchmarking ...
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Select 10 columns 13930 13996 60 0.7 1393.0 1.0X
Select 1 column 17092 17394 360 0.6 1709.2 0.8X
Select 10 columns 28017 28066 47 0.4 2801.7 1.0X
Select 1 column 24590 24641 67 0.4 2459.0 1.1X
Preparing data for benchmarking ...
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Short column without encoding 5596 5711 101 1.8 559.6 1.0X
Short column with UTF-8 7983 8158 160 1.3 798.3 0.7X
Wide column without encoding 110189 118451 NaN 0.1 11018.9 0.1X
Wide column with UTF-8 137827 142813 NaN 0.1 13782.7 0.0X
Short column without encoding 17179 17465 487 0.6 1717.9 1.0X
Short column with UTF-8 25173 25255 139 0.4 2517.3 0.7X
Wide column without encoding 146956 147069 104 0.1 14695.6 0.1X
Wide column with UTF-8 196626 197233 549 0.1 19662.6 0.1X
Preparing data for benchmarking ...
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Text read 951 953 2 10.5 95.1 1.0X
from_json 13015 13045 27 0.8 1301.5 0.1X
json_tuple 16257 16306 43 0.6 1625.7 0.1X
get_json_object 13195 13225 39 0.8 1319.5 0.1X
Text read 1206 1212 5 8.3 120.6 1.0X
from_json 27641 27680 34 0.4 2764.1 0.0X
json_tuple 43404 44377 860 0.2 4340.4 0.0X
get_json_object 26821 27239 619 0.4 2682.1 0.0X
Preparing data for benchmarking ...
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Text read 4632 4687 49 10.8 92.6 1.0X
schema inferring 29176 29297 146 1.7 583.5 0.2X
parsing 24268 24457 175 2.1 485.4 0.2X
Text read 5842 5865 33 8.6 116.8 1.0X
schema inferring 69673 70082 478 0.7 1393.5 0.1X
parsing 78805 81812 NaN 0.6 1576.1 0.1X
Preparing data for benchmarking ...
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Text read 8264 8272 7 6.1 165.3 1.0X
Schema inferring 31910 32375 543 1.6 638.2 0.3X
Parsing without charset 29290 29397 124 1.7 585.8 0.3X
Parsing with UTF-8 41301 41390 81 1.2 826.0 0.2X
Text read 10782 10801 18 4.6 215.6 1.0X
Schema inferring 76817 77205 623 0.7 1536.3 0.1X
Parsing without charset 90638 91395 794 0.6 1812.8 0.1X
Parsing with UTF-8 120085 121975 1705 0.4 2401.7 0.1X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Create a dataset of timestamps 1149 1160 11 8.7 114.9 1.0X
to_json(timestamp) 11585 11688 140 0.9 1158.5 0.1X
write timestamps to files 10212 10260 49 1.0 1021.2 0.1X
Create a dataset of dates 1322 1328 10 7.6 132.2 0.9X
to_json(date) 7226 7241 14 1.4 722.6 0.2X
write dates to files 5634 5648 20 1.8 563.4 0.2X
Create a dataset of timestamps 4706 4717 9 2.1 470.6 1.0X
to_json(timestamp) 29447 29615 226 0.3 2944.7 0.2X
write timestamps to files 20251 20673 503 0.5 2025.1 0.2X
Create a dataset of dates 4157 4172 18 2.4 415.7 1.1X
to_json(date) 21267 21301 53 0.5 2126.7 0.2X
write dates to files 13477 13897 485 0.7 1347.7 0.3X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
read timestamp text from files 2097 2137 41 4.8 209.7 1.0X
read timestamps from files 20438 20451 11 0.5 2043.8 0.1X
infer timestamps from files 41694 41770 66 0.2 4169.4 0.1X
read date text from files 1832 1847 16 5.5 183.2 1.1X
read date from files 13796 13837 49 0.7 1379.6 0.2X
timestamp strings 3213 3233 26 3.1 321.3 0.7X
parse timestamps from Dataset[String] 22686 22743 53 0.4 2268.6 0.1X
infer timestamps from Dataset[String] 45301 45368 58 0.2 4530.1 0.0X
date strings 3431 3439 7 2.9 343.1 0.6X
parse dates from Dataset[String] 17688 17734 41 0.6 1768.8 0.1X
from_json(timestamp) 33439 33456 24 0.3 3343.9 0.1X
from_json(date) 24055 24164 107 0.4 2405.5 0.1X
read timestamp text from files 2666 2687 29 3.8 266.6 1.0X
read timestamps from files 46967 47354 438 0.2 4696.7 0.1X
infer timestamps from files 97693 97745 65 0.1 9769.3 0.0X
read date text from files 2594 2599 5 3.9 259.4 1.0X
read date from files 35796 36008 195 0.3 3579.6 0.1X
timestamp strings 6367 6424 84 1.6 636.7 0.4X
parse timestamps from Dataset[String] 58863 59255 340 0.2 5886.3 0.0X
infer timestamps from Dataset[String] 114148 114820 836 0.1 11414.8 0.0X
date strings 7847 7863 22 1.3 784.7 0.3X
parse dates from Dataset[String] 49085 49289 212 0.2 4908.5 0.1X
from_json(timestamp) 77030 77335 395 0.1 7703.0 0.0X
from_json(date) 63275 63290 15 0.2 6327.5 0.0X

75
sql/core/benchmarks/JoinBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,75 @@
================================================================================================
Join Benchmark
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w long wholestage off 4872 4888 24 4.3 232.3 1.0X
Join w long wholestage on 337 425 61 62.3 16.1 14.5X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w long duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w long duplicated wholestage off 6290 6346 79 3.3 299.9 1.0X
Join w long duplicated wholestage on 328 347 17 64.0 15.6 19.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w 2 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w 2 ints wholestage off 174475 174532 82 0.1 8319.6 1.0X
Join w 2 ints wholestage on 165490 167355 1507 0.1 7891.2 1.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w 2 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w 2 longs wholestage off 7025 7121 135 3.0 335.0 1.0X
Join w 2 longs wholestage on 1878 1954 103 11.2 89.5 3.7X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w 2 longs duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w 2 longs duplicated wholestage off 20822 20879 81 1.0 992.9 1.0X
Join w 2 longs duplicated wholestage on 2454 2512 60 8.5 117.0 8.5X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
outer join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
outer join w long wholestage off 3900 3907 10 5.4 186.0 1.0X
outer join w long wholestage on 226 235 10 92.6 10.8 17.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
semi join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
semi join w long wholestage off 2560 2621 87 8.2 122.1 1.0X
semi join w long wholestage on 209 219 15 100.5 10.0 12.3X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
sort merge join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
sort merge join wholestage off 1707 1712 7 1.2 814.0 1.0X
sort merge join wholestage on 1447 1482 43 1.4 690.0 1.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
sort merge join with duplicates wholestage off 2293 2307 19 0.9 1093.4 1.0X
sort merge join with duplicates wholestage on 2018 2061 66 1.0 962.1 1.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
shuffle hash join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
shuffle hash join wholestage off 1424 1458 47 2.9 339.6 1.0X
shuffle hash join wholestage on 1203 1227 28 3.5 286.9 1.2X

100
sql/core/benchmarks/JoinBenchmark-results.txt
View file

@ -2,74 +2,74 @@
Join Benchmark
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Join w long wholestage off 4464 / 4483 4.7 212.9 1.0X
Join w long wholestage on 289 / 339 72.6 13.8 15.5X
Join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w long wholestage off 4685 4814 182 4.5 223.4 1.0X
Join w long wholestage on 440 524 102 47.7 21.0 10.7X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w long duplicated: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Join w long duplicated wholestage off 5662 / 5678 3.7 270.0 1.0X
Join w long duplicated wholestage on 332 / 345 63.1 15.8 17.0X
Join w long duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w long duplicated wholestage off 6266 6291 35 3.3 298.8 1.0X
Join w long duplicated wholestage on 340 359 27 61.7 16.2 18.4X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w 2 ints: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Join w 2 ints wholestage off 173174 / 173183 0.1 8257.6 1.0X
Join w 2 ints wholestage on 166350 / 198362 0.1 7932.2 1.0X
Join w 2 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w 2 ints wholestage off 174733 174916 259 0.1 8331.9 1.0X
Join w 2 ints wholestage on 166815 167619 823 0.1 7954.4 1.0X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w 2 longs: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Join w 2 longs wholestage off 7055 / 7214 3.0 336.4 1.0X
Join w 2 longs wholestage on 1869 / 1985 11.2 89.1 3.8X
Join w 2 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w 2 longs wholestage off 7835 7889 76 2.7 373.6 1.0X
Join w 2 longs wholestage on 2057 2148 73 10.2 98.1 3.8X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Join w 2 longs duplicated: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Join w 2 longs duplicated wholestage off 19256 / 20283 1.1 918.2 1.0X
Join w 2 longs duplicated wholestage on 2467 / 2544 8.5 117.7 7.8X
Join w 2 longs duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Join w 2 longs duplicated wholestage off 19435 19497 87 1.1 926.7 1.0X
Join w 2 longs duplicated wholestage on 2472 2528 57 8.5 117.9 7.9X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
outer join w long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
outer join w long wholestage off 3756 / 3761 5.6 179.1 1.0X
outer join w long wholestage on 218 / 250 96.2 10.4 17.2X
outer join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
outer join w long wholestage off 3945 3992 66 5.3 188.1 1.0X
outer join w long wholestage on 227 235 11 92.5 10.8 17.4X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
semi join w long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
semi join w long wholestage off 2393 / 2416 8.8 114.1 1.0X
semi join w long wholestage on 214 / 218 97.9 10.2 11.2X
semi join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
semi join w long wholestage off 2436 2469 46 8.6 116.2 1.0X
semi join w long wholestage on 231 242 11 91.0 11.0 10.6X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
sort merge join: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
sort merge join wholestage off 2318 / 2392 0.9 1105.3 1.0X
sort merge join wholestage on 1669 / 1811 1.3 795.9 1.4X
sort merge join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
sort merge join wholestage off 1820 1825 7 1.2 867.9 1.0X
sort merge join wholestage on 1507 1552 34 1.4 718.8 1.2X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
sort merge join with duplicates: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
sort merge join with duplicates wholestage off 2966 / 2976 0.7 1414.5 1.0X
sort merge join with duplicates wholestage on 2413 / 2641 0.9 1150.5 1.2X
sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
sort merge join with duplicates wholestage off 2319 2380 86 0.9 1105.7 1.0X
sort merge join with duplicates wholestage on 2087 2139 51 1.0 995.3 1.1X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
shuffle hash join: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
shuffle hash join wholestage off 1475 / 1479 2.8 351.7 1.0X
shuffle hash join wholestage on 1209 / 1238 3.5 288.3 1.2X
shuffle hash join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
shuffle hash join wholestage off 1554 1591 52 2.7 370.6 1.0X
shuffle hash join wholestage on 1142 1200 51 3.7 272.2 1.4X

22
sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,22 @@
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
prepare make_date() 2952 3104 224 33.9 29.5 1.0X
make_date(2019, 9, 16) 2341 2585 359 42.7 23.4 1.3X
make_date(*, *, *) 4751 4808 53 21.0 47.5 0.6X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
make_timestamp(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
prepare make_timestamp() 3462 3585 143 0.3 3461.8 1.0X
make_timestamp(2019, 1, 2, 3, 4, 50.123456) 114 120 6 8.7 114.4 30.3X
make_timestamp(2019, 1, 2, 3, 4, 60.000000) 74 82 13 13.5 74.0 46.8X
make_timestamp(2019, 12, 31, 23, 59, 60.00) 82 95 11 12.1 82.5 42.0X
make_timestamp(*, *, *, 3, 4, 50.123456) 293 308 14 3.4 292.9 11.8X
make_timestamp(*, *, *, *, *, 0) 278 284 9 3.6 278.1 12.4X
make_timestamp(*, *, *, *, *, 60.0) 287 289 2 3.5 287.3 12.0X
make_timestamp(2019, 1, 2, *, *, *) 3556 3574 21 0.3 3555.7 1.0X
make_timestamp(*, *, *, *, *, *) 3578 3590 16 0.3 3577.9 1.0X

32
sql/core/benchmarks/MakeDateTimeBenchmark-results.txt
View file

@ -1,22 +1,22 @@
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
prepare make_date() 2149 2289 196 46.5 21.5 1.0X
make_date(2019, 9, 16) 1829 1868 58 54.7 18.3 1.2X
make_date(*, *, *) 3180 3339 139 31.4 31.8 0.7X
prepare make_date() 2990 3159 267 33.4 29.9 1.0X
make_date(2019, 9, 16) 2376 2446 90 42.1 23.8 1.3X
make_date(*, *, *) 4751 4786 31 21.0 47.5 0.6X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6
Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
make_timestamp(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
prepare make_timestamp() 2950 3025 96 0.3 2950.3 1.0X
make_timestamp(2019, 1, 2, 3, 4, 50.123456) 45 47 1 22.1 45.2 65.3X
make_timestamp(2019, 1, 2, 3, 4, 60.000000) 42 42 1 24.0 41.7 70.8X
make_timestamp(2019, 12, 31, 23, 59, 60.00) 41 42 1 24.2 41.3 71.4X
make_timestamp(*, *, *, 3, 4, 50.123456) 252 256 7 4.0 251.5 11.7X
make_timestamp(*, *, *, *, *, 0) 225 227 3 4.5 224.6 13.1X
make_timestamp(*, *, *, *, *, 60.0) 230 233 2 4.3 230.4 12.8X
make_timestamp(2019, 1, 2, *, *, *) 3078 3118 35 0.3 3078.5 1.0X
make_timestamp(*, *, *, *, *, *) 3092 3109 17 0.3 3092.4 1.0X
prepare make_timestamp() 3855 3936 104 0.3 3855.3 1.0X
make_timestamp(2019, 1, 2, 3, 4, 50.123456) 83 87 5 12.0 83.1 46.4X
make_timestamp(2019, 1, 2, 3, 4, 60.000000) 73 82 9 13.8 72.7 53.0X
make_timestamp(2019, 12, 31, 23, 59, 60.00) 66 74 9 15.2 65.8 58.6X
make_timestamp(*, *, *, 3, 4, 50.123456) 266 277 11 3.8 265.9 14.5X
make_timestamp(*, *, *, *, *, 0) 268 275 13 3.7 267.6 14.4X
make_timestamp(*, *, *, *, *, 60.0) 272 273 0 3.7 272.4 14.2X
make_timestamp(2019, 1, 2, *, *, *) 3940 3966 24 0.3 3940.4 1.0X
make_timestamp(*, *, *, *, *, *) 3867 3917 68 0.3 3867.4 1.0X

127
sql/core/benchmarks/MiscBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,127 @@
================================================================================================
filter & aggregate without group
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
range/filter/sum wholestage off 52841 53513 951 39.7 25.2 1.0X
range/filter/sum wholestage on 3104 3188 109 675.6 1.5 17.0X
================================================================================================
range/limit/sum
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
range/limit/sum wholestage off 199 222 32 2633.5 0.4 1.0X
range/limit/sum wholestage on 131 138 7 3991.0 0.3 1.5X
================================================================================================
sample
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
sample with replacement wholestage off 13015 13441 602 10.1 99.3 1.0X
sample with replacement wholestage on 7688 7745 91 17.0 58.7 1.7X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
sample without replacement wholestage off 2990 2993 4 43.8 22.8 1.0X
sample without replacement wholestage on 1172 1186 13 111.9 8.9 2.6X
================================================================================================
collect
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
collect 1 million 317 425 188 3.3 301.9 1.0X
collect 2 millions 575 598 26 1.8 548.2 0.6X
collect 4 millions 1350 1848 704 0.8 1287.6 0.2X
================================================================================================
collect limit
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
collect limit 1 million 375 387 14 2.8 358.0 1.0X
collect limit 2 millions 714 736 28 1.5 681.3 0.5X
================================================================================================
generate explode
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate explode array wholestage off 19669 19829 227 0.9 1172.3 1.0X
generate explode array wholestage on 10983 11020 35 1.5 654.7 1.8X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate explode map wholestage off 57756 57928 243 0.3 3442.5 1.0X
generate explode map wholestage on 47398 47703 250 0.4 2825.2 1.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate posexplode array wholestage off 21402 21525 174 0.8 1275.7 1.0X
generate posexplode array wholestage on 11898 11982 67 1.4 709.2 1.8X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate inline array wholestage off 15570 15597 37 1.1 928.1 1.0X
generate inline array wholestage on 10044 10161 87 1.7 598.6 1.6X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate big struct array wholestage off 601 615 19 0.1 10023.5 1.0X
generate big struct array wholestage on 388 410 25 0.2 6458.7 1.6X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate big nested struct array wholestage off 492 525 48 0.1 8191.7 1.0X
generate big nested struct array wholestage on 468 496 30 0.1 7796.4 1.1X
================================================================================================
generate regular generator
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate stack wholestage off 28014 28091 109 0.6 1669.8 1.0X
generate stack wholestage on 19246 19267 27 0.9 1147.2 1.5X

128
sql/core/benchmarks/MiscBenchmark-results.txt
View file

@ -2,126 +2,126 @@
filter & aggregate without group
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
range/filter/sum: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
range/filter/sum wholestage off 47752 / 48952 43.9 22.8 1.0X
range/filter/sum wholestage on 3123 / 3558 671.5 1.5 15.3X
range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
range/filter/sum wholestage off 45894 47528 2310 45.7 21.9 1.0X
range/filter/sum wholestage on 3193 3572 213 656.8 1.5 14.4X
================================================================================================
range/limit/sum
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
range/limit/sum: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
range/limit/sum wholestage off 229 / 236 2288.9 0.4 1.0X
range/limit/sum wholestage on 257 / 267 2041.0 0.5 0.9X
range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
range/limit/sum wholestage off 202 207 7 2593.1 0.4 1.0X
range/limit/sum wholestage on 148 161 20 3545.1 0.3 1.4X
================================================================================================
sample
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
sample with replacement: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
sample with replacement wholestage off 12908 / 13076 10.2 98.5 1.0X
sample with replacement wholestage on 7334 / 7346 17.9 56.0 1.8X
sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
sample with replacement wholestage off 12337 12657 452 10.6 94.1 1.0X
sample with replacement wholestage on 7355 7368 14 17.8 56.1 1.7X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
sample without replacement: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
sample without replacement wholestage off 3082 / 3095 42.5 23.5 1.0X
sample without replacement wholestage on 1125 / 1211 116.5 8.6 2.7X
sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
sample without replacement wholestage off 3050 3060 14 43.0 23.3 1.0X
sample without replacement wholestage on 1103 1118 22 118.8 8.4 2.8X
================================================================================================
collect
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
collect: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
collect 1 million 291 / 311 3.6 277.3 1.0X
collect 2 millions 552 / 564 1.9 526.6 0.5X
collect 4 millions 1104 / 1108 0.9 1053.0 0.3X
collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
collect 1 million 324 361 41 3.2 309.4 1.0X
collect 2 millions 619 700 70 1.7 590.4 0.5X
collect 4 millions 1214 1293 111 0.9 1158.2 0.3X
================================================================================================
collect limit
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
collect limit: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
collect limit 1 million 311 / 340 3.4 296.2 1.0X
collect limit 2 millions 581 / 614 1.8 554.4 0.5X
collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
collect limit 1 million 391 396 5 2.7 373.0 1.0X
collect limit 2 millions 746 769 26 1.4 711.8 0.5X
================================================================================================
generate explode
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate explode array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
generate explode array wholestage off 15211 / 15368 1.1 906.6 1.0X
generate explode array wholestage on 10761 / 10776 1.6 641.4 1.4X
generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate explode array wholestage off 15063 16007 1335 1.1 897.8 1.0X
generate explode array wholestage on 10909 10932 20 1.5 650.2 1.4X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate explode map: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
generate explode map wholestage off 22128 / 22578 0.8 1318.9 1.0X
generate explode map wholestage on 16421 / 16520 1.0 978.8 1.3X
generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate explode map wholestage off 55011 55580 806 0.3 3278.9 1.0X
generate explode map wholestage on 46009 46445 399 0.4 2742.3 1.2X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate posexplode array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
generate posexplode array wholestage off 17108 / 18019 1.0 1019.7 1.0X
generate posexplode array wholestage on 11715 / 11804 1.4 698.3 1.5X
generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate posexplode array wholestage off 17987 18866 1244 0.9 1072.1 1.0X
generate posexplode array wholestage on 11400 11444 38 1.5 679.5 1.6X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate inline array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
generate inline array wholestage off 16358 / 16418 1.0 975.0 1.0X
generate inline array wholestage on 11152 / 11472 1.5 664.7 1.5X
generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate inline array wholestage off 14905 14991 122 1.1 888.4 1.0X
generate inline array wholestage on 9919 10129 160 1.7 591.2 1.5X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate big struct array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
generate big struct array wholestage off 708 / 776 0.1 11803.5 1.0X
generate big struct array wholestage on 535 / 589 0.1 8913.9 1.3X
generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate big struct array wholestage off 508 577 98 0.1 8474.0 1.0X
generate big struct array wholestage on 451 485 26 0.1 7523.2 1.1X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate big nested struct array wholestage off 540 553 19 0.1 8997.4 1.0X
generate big nested struct array wholestage on 523 554 31 0.1 8725.0 1.0X
generate big nested struct array wholestage off 537 567 43 0.1 8944.4 1.0X
generate big nested struct array wholestage on 528 546 24 0.1 8804.2 1.0X
================================================================================================
generate regular generator
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
generate stack: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
generate stack wholestage off 29082 / 29393 0.6 1733.4 1.0X
generate stack wholestage on 21066 / 21128 0.8 1255.6 1.4X
generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
generate stack wholestage off 27220 27608 548 0.6 1622.5 1.0X
generate stack wholestage on 20070 20170 117 0.8 1196.3 1.4X

53
sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,53 @@
================================================================================================
Nested Schema Pruning Benchmark For ORC v1
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 150 192 23 6.7 150.1 1.0X
Nested column 1241 1289 82 0.8 1241.3 0.1X
Nested column in array 5466 5574 114 0.2 5465.6 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 463 515 30 2.2 462.6 1.0X
Nested column 1920 1967 27 0.5 1920.1 0.2X
Nested column in array 6565 6685 123 0.2 6564.8 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 387 431 80 2.6 387.0 1.0X
Nested column 1846 1865 13 0.5 1846.2 0.2X
Nested column in array 6458 6569 114 0.2 6458.2 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 391 405 13 2.6 390.9 1.0X
Nested column 4597 4684 81 0.2 4597.4 0.1X
Nested column in array 9434 9499 54 0.1 9433.9 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 131 165 27 7.6 130.9 1.0X
Nested column 1258 1298 31 0.8 1257.7 0.1X
Nested column in array 5360 5393 16 0.2 5359.7 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 584 632 63 1.7 583.7 1.0X
Nested column 5211 5384 108 0.2 5211.1 0.1X
Nested column in array 10279 10397 94 0.1 10279.0 0.1X

48
sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt
View file

@ -2,52 +2,52 @@
Nested Schema Pruning Benchmark For ORC v1
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 127 163 24 7.9 127.1 1.0X
Nested column 974 1023 39 1.0 974.2 0.1X
Nested column in array 4834 4857 23 0.2 4834.1 0.0X
Top-level column 131 167 24 7.6 131.0 1.0X
Nested column 1296 1340 33 0.8 1296.0 0.1X
Nested column in array 5568 5745 243 0.2 5567.8 0.0X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 454 488 45 2.2 454.3 1.0X
Nested column 1539 1602 80 0.6 1539.3 0.3X
Nested column in array 5765 5848 69 0.2 5764.7 0.1X
Top-level column 432 468 33 2.3 431.6 1.0X
Nested column 1778 1828 35 0.6 1777.7 0.2X
Nested column in array 6565 6727 137 0.2 6565.1 0.1X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 365 395 58 2.7 364.9 1.0X
Nested column 1456 1477 23 0.7 1456.0 0.3X
Nested column in array 5734 5842 91 0.2 5734.4 0.1X
Top-level column 365 406 60 2.7 365.3 1.0X
Nested column 1803 1821 22 0.6 1803.2 0.2X
Nested column in array 6453 6530 111 0.2 6453.5 0.1X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 373 387 15 2.7 372.8 1.0X
Nested column 4349 4397 59 0.2 4348.8 0.1X
Nested column in array 8893 8971 73 0.1 8893.2 0.0X
Top-level column 370 390 30 2.7 369.6 1.0X
Nested column 4955 5028 61 0.2 4955.0 0.1X
Nested column in array 10490 10553 49 0.1 10490.5 0.0X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 130 159 24 7.7 129.9 1.0X
Nested column 1160 1216 50 0.9 1159.8 0.1X
Nested column in array 5297 5420 176 0.2 5296.8 0.0X
Top-level column 135 150 18 7.4 134.5 1.0X
Nested column 1615 1717 78 0.6 1615.0 0.1X
Nested column in array 6919 7024 53 0.1 6919.4 0.0X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 585 615 60 1.7 585.5 1.0X
Nested column 4972 5213 156 0.2 4972.2 0.1X
Nested column in array 10095 10156 32 0.1 10095.4 0.1X
Top-level column 580 619 28 1.7 580.4 1.0X
Nested column 5547 5752 185 0.2 5547.3 0.1X
Nested column in array 11639 11838 183 0.1 11639.4 0.0X

53
sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,53 @@
================================================================================================
Nested Schema Pruning Benchmark For ORC v2
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 150 187 20 6.7 150.2 1.0X
Nested column 1370 1463 104 0.7 1369.8 0.1X
Nested column in array 6575 6656 66 0.2 6575.2 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 134 161 20 7.5 133.7 1.0X
Nested column 1532 1550 15 0.7 1532.4 0.1X
Nested column in array 6601 6688 126 0.2 6601.4 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 409 491 190 2.4 409.5 1.0X
Nested column 1896 1938 60 0.5 1896.2 0.2X
Nested column in array 7414 7472 43 0.1 7414.0 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 408 433 37 2.5 408.1 1.0X
Nested column 4703 4795 101 0.2 4703.4 0.1X
Nested column in array 10477 10556 61 0.1 10476.6 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 130 164 31 7.7 130.3 1.0X
Nested column 1471 1513 44 0.7 1470.5 0.1X
Nested column in array 6492 6551 55 0.2 6492.0 0.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 268 283 14 3.7 268.4 1.0X
Nested column 3347 3401 77 0.3 3347.3 0.1X
Nested column in array 9297 9433 237 0.1 9296.6 0.0X

48
sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt
View file

@ -2,52 +2,52 @@
Nested Schema Pruning Benchmark For ORC v2
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 122 161 29 8.2 121.9 1.0X
Nested column 1255 1279 23 0.8 1255.4 0.1X
Nested column in array 5352 5393 37 0.2 5352.3 0.0X
Top-level column 141 161 22 7.1 140.6 1.0X
Nested column 1425 1455 26 0.7 1424.7 0.1X
Nested column in array 5248 5300 46 0.2 5247.5 0.0X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 132 162 32 7.6 131.8 1.0X
Nested column 1246 1286 32 0.8 1245.6 0.1X
Nested column in array 5395 5542 143 0.2 5394.9 0.0X
Top-level column 133 163 22 7.5 132.8 1.0X
Nested column 1254 1308 40 0.8 1254.0 0.1X
Nested column in array 5303 5418 81 0.2 5303.3 0.0X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 385 403 20 2.6 385.4 1.0X
Nested column 1663 1691 52 0.6 1663.2 0.2X
Nested column in array 6264 6335 73 0.2 6264.4 0.1X
Top-level column 377 401 19 2.7 376.7 1.0X
Nested column 1676 1722 21 0.6 1676.1 0.2X
Nested column in array 6019 6127 109 0.2 6018.7 0.1X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 392 422 58 2.5 392.2 1.0X
Nested column 4104 4153 57 0.2 4104.0 0.1X
Nested column in array 8668 8748 55 0.1 8668.3 0.0X
Top-level column 390 447 151 2.6 390.1 1.0X
Nested column 4300 4364 60 0.2 4299.7 0.1X
Nested column in array 8832 9030 114 0.1 8832.4 0.0X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 130 146 22 7.7 130.1 1.0X
Nested column 1127 1166 53 0.9 1127.3 0.1X
Nested column in array 4906 4968 40 0.2 4905.8 0.0X
Top-level column 132 143 7 7.6 131.6 1.0X
Nested column 1260 1303 20 0.8 1260.2 0.1X
Nested column in array 5359 5453 74 0.2 5359.1 0.0X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 291 308 25 3.4 290.5 1.0X
Nested column 3016 3091 58 0.3 3016.0 0.1X
Nested column in array 7730 7821 140 0.1 7729.5 0.0X
Top-level column 288 302 20 3.5 287.6 1.0X
Nested column 3169 3242 53 0.3 3168.7 0.1X
Nested column in array 8151 8301 123 0.1 8151.3 0.0X

53
sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,53 @@
================================================================================================
Nested Schema Pruning Benchmark For Parquet
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 164 191 18 6.1 163.6 1.0X
Nested column 416 444 26 2.4 415.7 0.4X
Nested column in array 1349 1398 39 0.7 1349.4 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 153 169 14 6.5 152.7 1.0X
Nested column 540 566 26 1.9 540.5 0.3X
Nested column in array 1378 1447 87 0.7 1378.0 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 414 433 26 2.4 414.0 1.0X
Nested column 736 777 56 1.4 736.2 0.6X
Nested column in array 1895 1954 86 0.5 1895.2 0.2X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 402 436 49 2.5 402.1 1.0X
Nested column 3190 3225 26 0.3 3190.4 0.1X
Nested column in array 3749 3806 68 0.3 3748.7 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 135 159 25 7.4 134.5 1.0X
Nested column 462 497 36 2.2 462.4 0.3X
Nested column in array 1453 1508 45 0.7 1453.5 0.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 277 301 27 3.6 277.3 1.0X
Nested column 2057 2097 33 0.5 2057.3 0.1X
Nested column in array 3027 3134 122 0.3 3027.4 0.1X

48
sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt
View file

@ -2,52 +2,52 @@
Nested Schema Pruning Benchmark For Parquet
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 151 174 16 6.6 151.3 1.0X
Nested column 316 375 88 3.2 315.7 0.5X
Nested column in array 1277 1292 11 0.8 1277.0 0.1X
Top-level column 149 183 22 6.7 148.8 1.0X
Nested column 413 436 20 2.4 413.4 0.4X
Nested column in array 1309 1327 24 0.8 1308.9 0.1X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 452 501 67 2.2 451.9 1.0X
Nested column 664 722 77 1.5 664.4 0.7X
Nested column in array 1906 1997 91 0.5 1905.6 0.2X
Top-level column 160 184 17 6.3 159.5 1.0X
Nested column 436 481 77 2.3 436.5 0.4X
Nested column in array 1354 1381 26 0.7 1353.6 0.1X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 385 410 39 2.6 385.5 1.0X
Nested column 612 620 10 1.6 611.9 0.6X
Nested column in array 1790 1845 80 0.6 1789.5 0.2X
Top-level column 378 412 61 2.6 378.0 1.0X
Nested column 744 790 51 1.3 744.0 0.5X
Nested column in array 1915 1987 76 0.5 1915.0 0.2X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 386 402 26 2.6 386.0 1.0X
Nested column 2982 3057 64 0.3 2982.0 0.1X
Nested column in array 3504 3690 248 0.3 3503.7 0.1X
Top-level column 389 407 16 2.6 388.6 1.0X
Nested column 3152 3217 48 0.3 3151.9 0.1X
Nested column in array 3698 3860 274 0.3 3698.2 0.1X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 138 152 10 7.2 138.3 1.0X
Nested column 345 369 16 2.9 344.8 0.4X
Nested column in array 1358 1405 50 0.7 1358.5 0.1X
Top-level column 143 170 27 7.0 142.7 1.0X
Nested column 450 461 8 2.2 449.9 0.3X
Nested column in array 1411 1460 41 0.7 1411.2 0.1X
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 606 632 45 1.6 606.3 1.0X
Nested column 3586 3679 107 0.3 3585.8 0.2X
Nested column in array 4452 4831 244 0.2 4451.8 0.1X
Top-level column 293 309 22 3.4 292.9 1.0X
Nested column 2109 2142 19 0.5 2109.1 0.1X
Nested column in array 3018 3096 79 0.3 3017.7 0.1X

12
sql/core/benchmarks/PrimitiveArrayBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,12 @@
================================================================================================
Write primitive arrays in dataset
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write an array in Dataset: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 636 681 50 13.2 75.8 1.0X
Double 727 809 71 11.5 86.7 0.9X

4
sql/core/benchmarks/PrimitiveArrayBenchmark-results.txt
View file

@ -6,7 +6,7 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write an array in Dataset: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 543 605 67 15.4 64.7 1.0X
Double 737 776 36 11.4 87.9 0.7X
Int 631 684 65 13.3 75.2 1.0X
Double 792 854 61 10.6 94.4 0.8X

15
sql/core/benchmarks/RangeBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,15 @@
================================================================================================
range
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
range: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
full scan 20357 21595 1692 25.8 38.8 1.0X
limit after range 115 130 15 4563.9 0.2 177.2X
filter after range 1890 1906 21 277.5 3.6 10.8X
count after range 85 87 3 6200.7 0.2 240.8X
count after limit after range 101 109 9 5213.9 0.2 202.4X

19
sql/core/benchmarks/RangeBenchmark-results.txt
View file

@ -2,15 +2,14 @@
range
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_161-b12 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz
range: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
full scan 12674 / 12840 41.4 24.2 1.0X
limit after range 33 / 37 15900.2 0.1 384.4X
filter after range 969 / 985 541.0 1.8 13.1X
count after range 42 / 42 12510.5 0.1 302.4X
count after limit after range 32 / 33 16337.0 0.1 394.9X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
range: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
full scan 19094 19768 459 27.5 36.4 1.0X
limit after range 90 108 19 5803.9 0.2 211.4X
filter after range 1807 1820 12 290.1 3.4 10.6X
count after range 88 93 6 5941.4 0.2 216.4X
count after limit after range 82 86 4 6398.2 0.2 233.0X

16
sql/core/benchmarks/SortBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,16 @@
================================================================================================
radix sort
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
radix sort 25000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
reference TimSort key prefix array 15588 15592 6 1.6 623.5 1.0X
reference Arrays.sort 3367 3377 14 7.4 134.7 4.6X
radix sort one byte 436 447 10 57.3 17.5 35.7X
radix sort two bytes 875 885 9 28.6 35.0 17.8X
radix sort eight bytes 3409 3429 27 7.3 136.4 4.6X
radix sort key prefix array 5985 6058 104 4.2 239.4 2.6X

21
sql/core/benchmarks/SortBenchmark-results.txt
View file

@ -2,16 +2,15 @@
radix sort
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_162-b12 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz
radix sort 25000000: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
reference TimSort key prefix array 11770 / 11960 2.1 470.8 1.0X
reference Arrays.sort 2106 / 2128 11.9 84.3 5.6X
radix sort one byte 93 / 100 269.7 3.7 126.9X
radix sort two bytes 171 / 179 146.0 6.9 68.7X
radix sort eight bytes 659 / 664 37.9 26.4 17.9X
radix sort key prefix array 1024 / 1053 24.4 41.0 11.5X
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
radix sort 25000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
reference TimSort key prefix array 15736 15778 59 1.6 629.4 1.0X
reference Arrays.sort 3051 3057 10 8.2 122.0 5.2X
radix sort one byte 442 453 10 56.6 17.7 35.6X
radix sort two bytes 883 885 1 28.3 35.3 17.8X
radix sort eight bytes 3422 3440 26 7.3 136.9 4.6X
radix sort key prefix array 6025 6138 159 4.1 241.0 2.6X

59
sql/core/benchmarks/UDFBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,59 @@
================================================================================================
UDF with mixed input types
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int/string to string wholestage off 289 302 18 0.3 2893.0 1.0X
long/nullable int/string to string wholestage on 141 165 20 0.7 1405.4 2.1X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int/string to option wholestage off 112 120 11 0.9 1124.6 1.0X
long/nullable int/string to option wholestage on 68 77 8 1.5 681.3 1.7X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int/string to primitive wholestage off 74 79 6 1.3 744.3 1.0X
long/nullable int/string to primitive wholestage on 71 83 10 1.4 713.5 1.0X
================================================================================================
UDF with primitive types
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int to string wholestage off 94 99 6 1.1 942.4 1.0X
long/nullable int to string wholestage on 58 60 1 1.7 584.3 1.6X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int to option wholestage off 43 46 5 2.3 425.7 1.0X
long/nullable int to option wholestage on 42 49 7 2.4 423.2 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int to primitive wholestage off 40 41 1 2.5 401.7 1.0X
long/nullable int to primitive wholestage on 40 44 5 2.5 400.1 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
UDF identity overhead: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Baseline 35 40 6 2.9 348.2 1.0X
With identity UDF 38 38 0 2.6 380.4 0.9X

56
sql/core/benchmarks/UDFBenchmark-results.txt
View file

@ -2,58 +2,58 @@
UDF with mixed input types
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int/string to string wholestage off 194 248 76 0,5 1941,4 1,0X
long/nullable int/string to string wholestage on 127 136 8 0,8 1269,5 1,5X
long/nullable int/string to string wholestage off 242 308 94 0.4 2416.5 1.0X
long/nullable int/string to string wholestage on 141 179 25 0.7 1410.3 1.7X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int/string to option wholestage off 91 97 8 1,1 910,1 1,0X
long/nullable int/string to option wholestage on 60 79 29 1,7 603,8 1,5X
long/nullable int/string to option wholestage off 91 97 9 1.1 908.1 1.0X
long/nullable int/string to option wholestage on 77 91 12 1.3 774.4 1.2X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int/string to primitive wholestage off 55 63 12 1,8 547,9 1,0X
long/nullable int/string to primitive wholestage on 43 44 2 2,3 428,0 1,3X
long/nullable int/string to primitive wholestage off 68 75 9 1.5 684.7 1.0X
long/nullable int/string to primitive wholestage on 62 64 3 1.6 619.8 1.1X
================================================================================================
UDF with primitive types
================================================================================================
Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int to string wholestage off 46 48 2 2,2 461,2 1,0X
long/nullable int to string wholestage on 49 56 8 2,0 488,9 0,9X
long/nullable int to string wholestage off 67 68 0 1.5 672.2 1.0X
long/nullable int to string wholestage on 66 72 11 1.5 660.5 1.0X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int to option wholestage off 41 47 9 2,4 408,2 1,0X
long/nullable int to option wholestage on 26 28 2 3,9 256,7 1,6X
long/nullable int to option wholestage off 53 57 5 1.9 528.1 1.0X
long/nullable int to option wholestage on 41 44 4 2.4 410.2 1.3X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
long/nullable int to primitive wholestage off 26 27 0 3,8 263,7 1,0X
long/nullable int to primitive wholestage on 26 31 5 3,8 262,2 1,0X
long/nullable int to primitive wholestage off 46 48 4 2.2 459.1 1.0X
long/nullable int to primitive wholestage on 40 40 0 2.5 398.0 1.2X
Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
UDF identity overhead: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Baseline 20 22 1 4,9 204,3 1,0X
With identity UDF 24 26 2 4,1 241,3 0,8X
Baseline 53 58 4 1.9 525.6 1.0X
With identity UDF 38 38 0 2.7 376.3 1.4X

33
sql/core/benchmarks/UnsafeArrayDataBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,33 @@
================================================================================================
Benchmark UnsafeArrayData
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Read UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 183 184 0 914.7 1.1 1.0X
Double 188 189 0 891.1 1.1 1.0X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 31 32 1 670.0 1.5 1.0X
Double 70 71 1 300.3 3.3 0.4X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Get primitive array from UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 71 73 3 887.3 1.1 1.0X
Double 144 151 6 438.2 2.3 0.5X
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Create UnsafeArrayData from primitive array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 69 70 1 906.7 1.1 1.0X
Double 140 142 1 448.8 2.2 0.5X

40
sql/core/benchmarks/UnsafeArrayDataBenchmark-results.txt
View file

@ -2,32 +2,32 @@
Benchmark UnsafeArrayData
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Read UnsafeArrayData: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Int 233 / 234 718.6 1.4 1.0X
Double 244 / 244 687.0 1.5 1.0X
Read UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 183 183 0 919.0 1.1 1.0X
Double 192 196 4 872.4 1.1 0.9X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Write UnsafeArrayData: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Int 32 / 33 658.6 1.5 1.0X
Double 73 / 75 287.0 3.5 0.4X
Write UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 33 36 3 639.3 1.6 1.0X
Double 76 79 2 274.6 3.6 0.4X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Get primitive array from UnsafeArrayData: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Int 70 / 72 895.0 1.1 1.0X
Double 141 / 143 446.9 2.2 0.5X
Get primitive array from UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 71 76 4 890.8 1.1 1.0X
Double 147 151 6 427.4 2.3 0.5X
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Create UnsafeArrayData from primitive array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
Int 72 / 73 874.7 1.1 1.0X
Double 145 / 146 433.7 2.3 0.5X
Create UnsafeArrayData from primitive array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Int 73 75 3 866.8 1.2 1.0X
Double 148 150 1 424.8 2.4 0.5X

17
sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt Normal file
View file

@ -0,0 +1,17 @@
================================================================================================
projection on wide table
================================================================================================
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
projection on wide table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
split threshold 10 42942 43023 108 0.0 40952.8 1.0X
split threshold 100 37236 37310 93 0.0 35510.9 1.2X
split threshold 1024 12198 12260 56 0.1 11633.1 3.5X
split threshold 2048 9789 9860 76 0.1 9335.2 4.4X
split threshold 4096 10120 10161 63 0.1 9651.0 4.2X
split threshold 8192 9961 9972 7 0.1 9499.1 4.3X
split threshold 65536 58987 59087 95 0.0 56254.5 0.7X

20
sql/core/benchmarks/WideTableBenchmark-results.txt
View file

@ -2,16 +2,16 @@
projection on wide table
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
projection on wide table: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------
split threshold 10 40571 / 40937 0.0 38691.7 1.0X
split threshold 100 31116 / 31669 0.0 29674.6 1.3X
split threshold 1024 10077 / 10199 0.1 9609.7 4.0X
split threshold 2048 8654 / 8692 0.1 8253.2 4.7X
split threshold 4096 8006 / 8038 0.1 7634.7 5.1X
split threshold 8192 8069 / 8107 0.1 7695.3 5.0X
split threshold 65536 56973 / 57204 0.0 54333.7 0.7X
projection on wide table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
split threshold 10 43737 44157 345 0.0 41711.3 1.0X
split threshold 100 33514 35770 1455 0.0 31961.3 1.3X
split threshold 1024 14959 15206 256 0.1 14265.8 2.9X
split threshold 2048 12024 12193 171 0.1 11467.2 3.6X
split threshold 4096 11378 11869 450 0.1 10851.1 3.8X
split threshold 8192 10588 10797 154 0.1 10097.8 4.1X
split threshold 65536 56801 57025 130 0.0 54169.4 0.8X