From 854a0f752e3125dc9bce6b91c80d6a7f534e9389 Mon Sep 17 00:00:00 2001 From: Dongjoon Hyun Date: Thu, 3 Oct 2019 08:58:25 -0700 Subject: [PATCH] [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1) ### What changes were proposed in this pull request? This PR regenerates the `sql/core` benchmarks in JDK8/11 to compare the result. In general, we compare the ratio instead of the time. However, in this PR, the average time is compared. This PR should be considered as a rough comparison. **A. EXPECTED CASES(JDK11 is faster in general)** - [x] BloomFilterBenchmark (JDK11 is faster except one case) - [x] BuiltInDataSourceWriteBenchmark (JDK11 is faster at CSV/ORC) - [x] CSVBenchmark (JDK11 is faster except five cases) - [x] ColumnarBatchBenchmark (JDK11 is faster at `boolean`/`string` and some cases in `int`/`array`) - [x] DatasetBenchmark (JDK11 is faster with `string`, but is slower for `long` type) - [x] ExternalAppendOnlyUnsafeRowArrayBenchmark (JDK11 is faster except two cases) - [x] ExtractBenchmark (JDK11 is faster except HOUR/MINUTE/SECOND/MILLISECONDS/MICROSECONDS) - [x] HashedRelationMetricsBenchmark (JDK11 is faster) - [x] JSONBenchmark (JDK11 is much faster except eight cases) - [x] JoinBenchmark (JDK11 is faster except five cases) - [x] OrcNestedSchemaPruningBenchmark (JDK11 is faster in nine cases) - [x] PrimitiveArrayBenchmark (JDK11 is faster) - [x] SortBenchmark (JDK11 is faster except `Arrays.sort` case) - [x] UDFBenchmark (N/A, values are too small) - [x] UnsafeArrayDataBenchmark (JDK11 is faster except one case) - [x] WideTableBenchmark (JDK11 is faster except two cases) **B. CASES WE NEED TO INVESTIGATE MORE LATER** - [x] AggregateBenchmark (JDK11 is slower in general) - [x] CompressionSchemeBenchmark (JDK11 is slower in general except `string`) - [x] DataSourceReadBenchmark (JDK11 is slower in general) - [x] DateTimeBenchmark (JDK11 is slightly slower in general except `parsing`) - [x] MakeDateTimeBenchmark (JDK11 is slower except two cases) - [x] MiscBenchmark (JDK11 is slower except ten cases) - [x] OrcV2NestedSchemaPruningBenchmark (JDK11 is slower) - [x] ParquetNestedSchemaPruningBenchmark (JDK11 is slower except six cases) - [x] RangeBenchmark (JDK11 is slower except one case) `FilterPushdownBenchmark/InExpressionBenchmark/WideSchemaBenchmark` will be compared later because it took long timer. ### Why are the changes needed? According to the result, there are some difference between JDK8/JDK11. This will be a baseline for the future improvement and comparison. Also, as a reproducible environment, the following environment is used. - Instance: `r3.xlarge` - OS: `CentOS Linux release 7.5.1804 (Core)` - JDK: - `OpenJDK Runtime Environment (build 1.8.0_222-b10)` - `OpenJDK Runtime Environment 18.9 (build 11.0.4+11-LTS)` ### Does this PR introduce any user-facing change? No. ### How was this patch tested? This is a test-only PR. We need to run benchmark. Closes #26003 from dongjoon-hyun/SPARK-29320. Authored-by: Dongjoon Hyun Signed-off-by: Dongjoon Hyun --- .../AggregateBenchmark-jdk11-results.txt | 143 ++++ .../benchmarks/AggregateBenchmark-results.txt | 142 ++-- .../BloomFilterBenchmark-jdk11-results.txt | 24 + .../BloomFilterBenchmark-results.txt | 20 +- ...DataSourceWriteBenchmark-jdk11-results.txt | 60 ++ ...uiltInDataSourceWriteBenchmark-results.txt | 64 +- .../benchmarks/CSVBenchmark-jdk11-results.txt | 59 ++ sql/core/benchmarks/CSVBenchmark-results.txt | 78 +-- .../ColumnarBatchBenchmark-jdk11-results.txt | 59 ++ .../ColumnarBatchBenchmark-results.txt | 62 +- ...mpressionSchemeBenchmark-jdk11-results.txt | 137 ++++ .../CompressionSchemeBenchmark-results.txt | 200 +++--- .../DataSourceReadBenchmark-jdk11-results.txt | 252 +++++++ .../DataSourceReadBenchmark-results.txt | 234 +++---- .../DatasetBenchmark-jdk11-results.txt | 46 ++ .../benchmarks/DatasetBenchmark-results.txt | 62 +- .../DateTimeBenchmark-jdk11-results.txt | 429 ++++++++++++ .../benchmarks/DateTimeBenchmark-results.txt | 642 +++++++++--------- ...yUnsafeRowArrayBenchmark-jdk11-results.txt | 45 ++ ...endOnlyUnsafeRowArrayBenchmark-results.txt | 50 +- .../ExtractBenchmark-jdk11-results.txt | 160 ++--- .../benchmarks/ExtractBenchmark-results.txt | 176 ++--- ...RelationMetricsBenchmark-jdk11-results.txt | 11 + ...HashedRelationMetricsBenchmark-results.txt | 10 +- .../JSONBenchmark-jdk11-results.txt | 112 +++ sql/core/benchmarks/JSONBenchmark-results.txt | 130 ++-- .../JoinBenchmark-jdk11-results.txt | 75 ++ sql/core/benchmarks/JoinBenchmark-results.txt | 100 +-- .../MakeDateTimeBenchmark-jdk11-results.txt | 22 + .../MakeDateTimeBenchmark-results.txt | 32 +- .../MiscBenchmark-jdk11-results.txt | 127 ++++ sql/core/benchmarks/MiscBenchmark-results.txt | 128 ++-- ...edSchemaPruningBenchmark-jdk11-results.txt | 53 ++ ...rcNestedSchemaPruningBenchmark-results.txt | 48 +- ...edSchemaPruningBenchmark-jdk11-results.txt | 53 ++ ...V2NestedSchemaPruningBenchmark-results.txt | 48 +- ...edSchemaPruningBenchmark-jdk11-results.txt | 53 ++ ...etNestedSchemaPruningBenchmark-results.txt | 48 +- .../PrimitiveArrayBenchmark-jdk11-results.txt | 12 + .../PrimitiveArrayBenchmark-results.txt | 4 +- .../RangeBenchmark-jdk11-results.txt | 15 + .../benchmarks/RangeBenchmark-results.txt | 19 +- .../SortBenchmark-jdk11-results.txt | 16 + sql/core/benchmarks/SortBenchmark-results.txt | 21 +- .../benchmarks/UDFBenchmark-jdk11-results.txt | 59 ++ sql/core/benchmarks/UDFBenchmark-results.txt | 56 +- ...UnsafeArrayDataBenchmark-jdk11-results.txt | 33 + .../UnsafeArrayDataBenchmark-results.txt | 40 +- .../WideTableBenchmark-jdk11-results.txt | 17 + .../benchmarks/WideTableBenchmark-results.txt | 20 +- 50 files changed, 3210 insertions(+), 1296 deletions(-) create mode 100644 sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/CSVBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/CompressionSchemeBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/DatasetBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/HashedRelationMetricsBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/JSONBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/JoinBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/MiscBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/PrimitiveArrayBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/RangeBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/SortBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/UDFBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/UnsafeArrayDataBenchmark-jdk11-results.txt create mode 100644 sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt diff --git a/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt b/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..e71d7ab0f3 --- /dev/null +++ b/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt @@ -0,0 +1,143 @@ +================================================================================================ +aggregate without grouping +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +agg w/o group wholestage off 55644 59484 NaN 37.7 26.5 1.0X +agg w/o group wholestage on 896 906 8 2340.7 0.4 62.1X + + +================================================================================================ +stat functions +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +stddev wholestage off 8655 9022 519 12.1 82.5 1.0X +stddev wholestage on 1306 1323 13 80.3 12.5 6.6X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +kurtosis wholestage off 40795 41041 349 2.6 389.0 1.0X +kurtosis wholestage on 1441 1468 22 72.8 13.7 28.3X + + +================================================================================================ +aggregate with linear keys +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 10559 10956 562 7.9 125.9 1.0X +codegen = T hashmap = F 6533 6567 34 12.8 77.9 1.6X +codegen = T hashmap = T 1362 1377 22 61.6 16.2 7.8X + + +================================================================================================ +aggregate with randomized keys +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 12631 12634 3 6.6 150.6 1.0X +codegen = T hashmap = F 8434 8478 44 9.9 100.5 1.5X +codegen = T hashmap = T 2484 2598 117 33.8 29.6 5.1X + + +================================================================================================ +aggregate with string key +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 4173 4204 44 5.0 199.0 1.0X +codegen = T hashmap = F 2664 2721 81 7.9 127.0 1.6X +codegen = T hashmap = T 1178 1219 59 17.8 56.2 3.5X + + +================================================================================================ +aggregate with decimal key +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 3740 3747 9 5.6 178.3 1.0X +codegen = T hashmap = F 2398 2528 184 8.7 114.3 1.6X +codegen = T hashmap = T 638 644 7 32.9 30.4 5.9X + + +================================================================================================ +aggregate with multiple key types +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 6874 6896 31 3.1 327.8 1.0X +codegen = T hashmap = F 3866 3886 28 5.4 184.3 1.8X +codegen = T hashmap = T 2619 2641 31 8.0 124.9 2.6X + + +================================================================================================ +max function bytecode size of wholestagecodegen +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 793 806 19 0.8 1209.7 1.0X +codegen = T hugeMethodLimit = 10000 401 456 61 1.6 611.2 2.0X +codegen = T hugeMethodLimit = 1500 694 715 19 0.9 1059.3 1.1X + + +================================================================================================ +cube +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +cube wholestage off 3616 3630 19 1.4 689.8 1.0X +cube wholestage on 1819 1866 41 2.9 347.0 2.0X + + +================================================================================================ +hash and BytesToBytesMap +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +UnsafeRowhash 321 321 1 65.4 15.3 1.0X +murmur3 hash 145 145 0 144.5 6.9 2.2X +fast hash 70 71 1 298.9 3.3 4.6X +arrayEqual 198 199 2 105.7 9.5 1.6X +Java HashMap (Long) 132 136 3 158.6 6.3 2.4X +Java HashMap (two ints) 152 156 4 138.3 7.2 2.1X +Java HashMap (UnsafeRow) 819 839 17 25.6 39.1 0.4X +LongToUnsafeRowMap (opt=false) 459 472 25 45.7 21.9 0.7X +LongToUnsafeRowMap (opt=true) 107 108 1 195.5 5.1 3.0X +BytesToBytesMap (off Heap) 1012 1019 10 20.7 48.3 0.3X +BytesToBytesMap (on Heap) 963 974 18 21.8 45.9 0.3X +Aggregate HashMap 41 43 2 515.1 1.9 7.9X + + diff --git a/sql/core/benchmarks/AggregateBenchmark-results.txt b/sql/core/benchmarks/AggregateBenchmark-results.txt index 19e5247776..ea8f113143 100644 --- a/sql/core/benchmarks/AggregateBenchmark-results.txt +++ b/sql/core/benchmarks/AggregateBenchmark-results.txt @@ -2,142 +2,142 @@ aggregate without grouping ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -agg w/o group: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -agg w/o group wholestage off 65374 / 70665 32.1 31.2 1.0X -agg w/o group wholestage on 1178 / 1209 1779.8 0.6 55.5X +agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +agg w/o group wholestage off 50499 52524 2863 41.5 24.1 1.0X +agg w/o group wholestage on 1163 1205 56 1803.1 0.6 43.4X ================================================================================================ stat functions ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -stddev: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -stddev wholestage off 8667 / 8851 12.1 82.7 1.0X -stddev wholestage on 1266 / 1273 82.8 12.1 6.8X +stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +stddev wholestage off 13393 13403 14 7.8 127.7 1.0X +stddev wholestage on 1291 1315 25 81.2 12.3 10.4X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -kurtosis: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -kurtosis wholestage off 41218 / 41231 2.5 393.1 1.0X -kurtosis wholestage on 1347 / 1357 77.8 12.8 30.6X +kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +kurtosis wholestage off 40131 40250 168 2.6 382.7 1.0X +kurtosis wholestage on 1435 1452 20 73.1 13.7 28.0X ================================================================================================ aggregate with linear keys ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Aggregate w keys: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -codegen = F 9309 / 9389 9.0 111.0 1.0X -codegen = T hashmap = F 4417 / 4435 19.0 52.7 2.1X -codegen = T hashmap = T 1289 / 1298 65.1 15.4 7.2X +Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 10008 10008 1 8.4 119.3 1.0X +codegen = T hashmap = F 5803 6158 370 14.5 69.2 1.7X +codegen = T hashmap = T 1332 1348 12 63.0 15.9 7.5X ================================================================================================ aggregate with randomized keys ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Aggregate w keys: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -codegen = F 11424 / 11426 7.3 136.2 1.0X -codegen = T hashmap = F 6441 / 6496 13.0 76.8 1.8X -codegen = T hashmap = T 2333 / 2344 36.0 27.8 4.9X +Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 11853 11988 191 7.1 141.3 1.0X +codegen = T hashmap = F 7469 7531 57 11.2 89.0 1.6X +codegen = T hashmap = T 2412 2436 24 34.8 28.8 4.9X ================================================================================================ aggregate with string key ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Aggregate w string key: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -codegen = F 4751 / 4890 4.4 226.5 1.0X -codegen = T hashmap = F 3146 / 3182 6.7 150.0 1.5X -codegen = T hashmap = T 2211 / 2261 9.5 105.4 2.1X +Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 4880 4908 40 4.3 232.7 1.0X +codegen = T hashmap = F 3483 3505 26 6.0 166.1 1.4X +codegen = T hashmap = T 2362 2425 39 8.9 112.6 2.1X ================================================================================================ aggregate with decimal key ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Aggregate w decimal key: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -codegen = F 3029 / 3062 6.9 144.4 1.0X -codegen = T hashmap = F 1534 / 1569 13.7 73.2 2.0X -codegen = T hashmap = T 575 / 578 36.5 27.4 5.3X +Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 3475 3516 58 6.0 165.7 1.0X +codegen = T hashmap = F 1939 1958 27 10.8 92.5 1.8X +codegen = T hashmap = T 599 609 9 35.0 28.6 5.8X ================================================================================================ aggregate with multiple key types ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Aggregate w multiple keys: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -codegen = F 7506 / 7521 2.8 357.9 1.0X -codegen = T hashmap = F 4791 / 4808 4.4 228.5 1.6X -codegen = T hashmap = T 3553 / 3585 5.9 169.4 2.1X +Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 7649 7675 37 2.7 364.7 1.0X +codegen = T hashmap = F 4729 4759 42 4.4 225.5 1.6X +codegen = T hashmap = T 3917 3929 16 5.4 186.8 2.0X ================================================================================================ max function bytecode size of wholestagecodegen ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -max function bytecode size: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -codegen = F 608 / 656 1.1 927.1 1.0X -codegen = T hugeMethodLimit = 10000 402 / 419 1.6 613.5 1.5X -codegen = T hugeMethodLimit = 1500 616 / 619 1.1 939.9 1.0X +max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +codegen = F 628 661 25 1.0 958.2 1.0X +codegen = T hugeMethodLimit = 10000 366 385 21 1.8 558.9 1.7X +codegen = T hugeMethodLimit = 1500 620 648 24 1.1 946.7 1.0X ================================================================================================ cube ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -cube: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -cube wholestage off 3229 / 3237 1.6 615.9 1.0X -cube wholestage on 1285 / 1306 4.1 245.2 2.5X +cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +cube wholestage off 3225 3273 68 1.6 615.1 1.0X +cube wholestage on 1636 1680 56 3.2 312.0 2.0X ================================================================================================ hash and BytesToBytesMap ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -BytesToBytesMap: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -UnsafeRowhash 328 / 330 64.0 15.6 1.0X -murmur3 hash 167 / 167 125.4 8.0 2.0X -fast hash 84 / 85 249.0 4.0 3.9X -arrayEqual 192 / 192 109.3 9.1 1.7X -Java HashMap (Long) 144 / 147 145.9 6.9 2.3X -Java HashMap (two ints) 147 / 153 142.3 7.0 2.2X -Java HashMap (UnsafeRow) 785 / 788 26.7 37.4 0.4X -LongToUnsafeRowMap (opt=false) 456 / 457 46.0 21.8 0.7X -LongToUnsafeRowMap (opt=true) 125 / 125 168.3 5.9 2.6X -BytesToBytesMap (off Heap) 885 / 885 23.7 42.2 0.4X -BytesToBytesMap (on Heap) 860 / 864 24.4 41.0 0.4X -Aggregate HashMap 56 / 56 373.9 2.7 5.8X +BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +UnsafeRowhash 331 332 0 63.3 15.8 1.0X +murmur3 hash 148 148 0 141.4 7.1 2.2X +fast hash 75 76 6 280.6 3.6 4.4X +arrayEqual 176 176 0 119.0 8.4 1.9X +Java HashMap (Long) 140 144 6 149.7 6.7 2.4X +Java HashMap (two ints) 153 157 5 137.2 7.3 2.2X +Java HashMap (UnsafeRow) 845 852 6 24.8 40.3 0.4X +LongToUnsafeRowMap (opt=false) 463 482 26 45.3 22.1 0.7X +LongToUnsafeRowMap (opt=true) 118 120 6 178.1 5.6 2.8X +BytesToBytesMap (off Heap) 935 937 2 22.4 44.6 0.4X +BytesToBytesMap (on Heap) 897 901 5 23.4 42.8 0.4X +Aggregate HashMap 57 58 0 369.9 2.7 5.8X diff --git a/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt b/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..9cd7ad16ac --- /dev/null +++ b/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt @@ -0,0 +1,24 @@ +================================================================================================ +ORC Write +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Without bloom filter 17367 17786 592 5.8 173.7 1.0X +With bloom filter 20556 20596 57 4.9 205.6 0.8X + + +================================================================================================ +ORC Read +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Without bloom filter 2204 2226 31 45.4 22.0 1.0X +With bloom filter 1415 1465 71 70.7 14.2 1.6X + + diff --git a/sql/core/benchmarks/BloomFilterBenchmark-results.txt b/sql/core/benchmarks/BloomFilterBenchmark-results.txt index 2eeb26c899..b4e3e84379 100644 --- a/sql/core/benchmarks/BloomFilterBenchmark-results.txt +++ b/sql/core/benchmarks/BloomFilterBenchmark-results.txt @@ -2,23 +2,23 @@ ORC Write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Write 100M rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Without bloom filter 16765 / 17587 6.0 167.7 1.0X -With bloom filter 20060 / 20626 5.0 200.6 0.8X +Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Without bloom filter 19489 19693 289 5.1 194.9 1.0X +With bloom filter 23045 23148 145 4.3 230.5 0.8X ================================================================================================ ORC Read ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Read a row from 100M rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Without bloom filter 1857 / 1904 53.9 18.6 1.0X -With bloom filter 1399 / 1437 71.5 14.0 1.3X +Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Without bloom filter 2038 2084 65 49.1 20.4 1.0X +With bloom filter 1465 1475 15 68.3 14.6 1.4X diff --git a/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk11-results.txt b/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..bc13f6e9b9 --- /dev/null +++ b/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk11-results.txt @@ -0,0 +1,60 @@ +================================================================================================ +Parquet writer benchmark +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Parquet writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Output Single Int Column 2552 2690 195 6.2 162.2 1.0X +Output Single Double Column 2865 2892 38 5.5 182.2 0.9X +Output Int and String Column 7876 7885 12 2.0 500.7 0.3X +Output Partitions 5079 5871 1120 3.1 322.9 0.5X +Output Buckets 6980 6994 20 2.3 443.8 0.4X + + +================================================================================================ +ORC writer benchmark +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +ORC writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Output Single Int Column 1799 1902 146 8.7 114.4 1.0X +Output Single Double Column 2268 2276 11 6.9 144.2 0.8X +Output Int and String Column 6650 6670 28 2.4 422.8 0.3X +Output Partitions 4697 4719 31 3.3 298.6 0.4X +Output Buckets 6394 6436 60 2.5 406.5 0.3X + + +================================================================================================ +JSON writer benchmark +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +JSON writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Output Single Int Column 2778 3522 1052 5.7 176.6 1.0X +Output Single Double Column 4222 4269 67 3.7 268.4 0.7X +Output Int and String Column 10822 10845 33 1.5 688.0 0.3X +Output Partitions 5450 5523 104 2.9 346.5 0.5X +Output Buckets 10827 11622 1123 1.5 688.4 0.3X + + +================================================================================================ +CSV writer benchmark +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +CSV writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Output Single Int Column 3649 3698 68 4.3 232.0 1.0X +Output Single Double Column 4612 4696 120 3.4 293.2 0.8X +Output Int and String Column 7334 7517 258 2.1 466.3 0.5X +Output Partitions 6386 6541 220 2.5 406.0 0.6X +Output Buckets 8692 9439 1057 1.8 552.6 0.4X + + diff --git a/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt b/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt index 9d656fc10d..1380a61589 100644 --- a/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt +++ b/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt @@ -2,59 +2,59 @@ Parquet writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Parquet writer benchmark: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Output Single Int Column 2354 / 2438 6.7 149.7 1.0X -Output Single Double Column 2462 / 2485 6.4 156.5 1.0X -Output Int and String Column 8083 / 8100 1.9 513.9 0.3X -Output Partitions 5015 / 5027 3.1 318.8 0.5X -Output Buckets 6883 / 6887 2.3 437.6 0.3X +Parquet writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Output Single Int Column 2537 2594 81 6.2 161.3 1.0X +Output Single Double Column 2615 2645 42 6.0 166.3 1.0X +Output Int and String Column 8931 8933 4 1.8 567.8 0.3X +Output Partitions 5011 5321 438 3.1 318.6 0.5X +Output Buckets 6789 6793 6 2.3 431.6 0.4X ================================================================================================ ORC writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -ORC writer benchmark: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Output Single Int Column 1769 / 1789 8.9 112.4 1.0X -Output Single Double Column 1989 / 2009 7.9 126.5 0.9X -Output Int and String Column 7323 / 7400 2.1 465.6 0.2X -Output Partitions 4374 / 4381 3.6 278.1 0.4X -Output Buckets 6086 / 6104 2.6 386.9 0.3X +ORC writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Output Single Int Column 1780 1937 222 8.8 113.2 1.0X +Output Single Double Column 2248 2265 23 7.0 142.9 0.8X +Output Int and String Column 7996 8031 49 2.0 508.4 0.2X +Output Partitions 4827 4939 159 3.3 306.9 0.4X +Output Buckets 6521 6595 104 2.4 414.6 0.3X ================================================================================================ JSON writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -JSON writer benchmark: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Output Single Int Column 2954 / 4085 5.3 187.8 1.0X -Output Single Double Column 3832 / 3837 4.1 243.6 0.8X -Output Int and String Column 9591 / 10336 1.6 609.8 0.3X -Output Partitions 4956 / 4994 3.2 315.1 0.6X -Output Buckets 6608 / 6676 2.4 420.1 0.4X +JSON writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Output Single Int Column 2791 2823 45 5.6 177.5 1.0X +Output Single Double Column 4078 5089 1431 3.9 259.3 0.7X +Output Int and String Column 10249 10296 66 1.5 651.6 0.3X +Output Partitions 5247 5296 69 3.0 333.6 0.5X +Output Buckets 8168 9714 2187 1.9 519.3 0.3X ================================================================================================ CSV writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -CSV writer benchmark: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Output Single Int Column 4118 / 4125 3.8 261.8 1.0X -Output Single Double Column 4888 / 4891 3.2 310.8 0.8X -Output Int and String Column 9788 / 9872 1.6 622.3 0.4X -Output Partitions 6578 / 6640 2.4 418.2 0.6X -Output Buckets 9125 / 9171 1.7 580.2 0.5X +CSV writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Output Single Int Column 4055 4200 205 3.9 257.8 1.0X +Output Single Double Column 4978 5010 45 3.2 316.5 0.8X +Output Int and String Column 9285 9294 13 1.7 590.3 0.4X +Output Partitions 6681 6738 80 2.4 424.8 0.6X +Output Buckets 9495 10052 787 1.7 603.7 0.4X diff --git a/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt b/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..b65b236fd7 --- /dev/null +++ b/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt @@ -0,0 +1,59 @@ +================================================================================================ +Benchmark to measure CSV read/write performance +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Parsing quoted values: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +One quoted string 56894 57106 184 0.0 1137889.9 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Wide rows with 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Select 1000 columns 220825 222234 2018 0.0 220825.5 1.0X +Select 100 columns 50507 50723 278 0.0 50506.6 4.4X +Select one column 38629 38642 16 0.0 38628.6 5.7X +count() 8549 8597 51 0.1 8549.2 25.8X +Select 100 columns, one bad input field 68309 68474 182 0.0 68309.2 3.2X +Select 100 columns, corrupt record field 74551 74701 136 0.0 74551.5 3.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Count a dataset with 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Select 10 columns + count() 27745 28050 276 0.4 2774.5 1.0X +Select 1 column + count() 19989 20315 319 0.5 1998.9 1.4X +count() 6091 6109 25 1.6 609.1 4.6X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Create a dataset of timestamps 2235 2301 59 4.5 223.5 1.0X +to_csv(timestamp) 16033 16205 153 0.6 1603.3 0.1X +write timestamps to files 13556 13685 167 0.7 1355.6 0.2X +Create a dataset of dates 2262 2290 44 4.4 226.2 1.0X +to_csv(date) 11122 11160 33 0.9 1112.2 0.2X +write dates to files 8436 8486 76 1.2 843.6 0.3X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +read timestamp text from files 2617 2644 26 3.8 261.7 1.0X +read timestamps from files 53245 53381 149 0.2 5324.5 0.0X +infer timestamps from files 103797 104026 257 0.1 10379.7 0.0X +read date text from files 2371 2378 7 4.2 237.1 1.1X +read date from files 41808 41929 177 0.2 4180.8 0.1X +infer date from files 35069 35336 458 0.3 3506.9 0.1X +timestamp strings 3104 3127 21 3.2 310.4 0.8X +parse timestamps from Dataset[String] 61888 62132 342 0.2 6188.8 0.0X +infer timestamps from Dataset[String] 112494 114609 1949 0.1 11249.4 0.0X +date strings 3558 3603 41 2.8 355.8 0.7X +parse dates from Dataset[String] 45871 46000 120 0.2 4587.1 0.1X +from_csv(timestamp) 56975 57035 53 0.2 5697.5 0.0X +from_csv(date) 43711 43795 74 0.2 4371.1 0.1X + + diff --git a/sql/core/benchmarks/CSVBenchmark-results.txt b/sql/core/benchmarks/CSVBenchmark-results.txt index 888c2ce9f2..d2037e86a3 100644 --- a/sql/core/benchmarks/CSVBenchmark-results.txt +++ b/sql/core/benchmarks/CSVBenchmark-results.txt @@ -2,58 +2,58 @@ Benchmark to measure CSV read/write performance ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parsing quoted values: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -One quoted string 36998 37134 120 0.0 739953.1 1.0X +One quoted string 62603 62755 133 0.0 1252055.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Wide rows with 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 1000 columns 140620 141162 737 0.0 140620.5 1.0X -Select 100 columns 35170 35287 183 0.0 35170.0 4.0X -Select one column 27711 27927 187 0.0 27710.9 5.1X -count() 7707 7804 84 0.1 7707.4 18.2X -Select 100 columns, one bad input field 41762 41851 117 0.0 41761.8 3.4X -Select 100 columns, corrupt record field 48717 48761 44 0.0 48717.4 2.9X +Select 1000 columns 225032 225919 782 0.0 225031.7 1.0X +Select 100 columns 51982 52290 286 0.0 51982.1 4.3X +Select one column 40167 40283 133 0.0 40167.4 5.6X +count() 11435 11593 176 0.1 11435.1 19.7X +Select 100 columns, one bad input field 66864 66968 174 0.0 66864.1 3.4X +Select 100 columns, corrupt record field 79570 80418 1080 0.0 79569.5 2.8X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Count a dataset with 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns + count() 16001 16053 53 0.6 1600.1 1.0X -Select 1 column + count() 11571 11614 58 0.9 1157.1 1.4X -count() 4752 4766 18 2.1 475.2 3.4X +Select 10 columns + count() 23271 23389 103 0.4 2327.1 1.0X +Select 1 column + count() 18206 19772 NaN 0.5 1820.6 1.3X +count() 8500 8521 18 1.2 850.0 2.7X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 1070 1072 2 9.3 107.0 1.0X -to_csv(timestamp) 10446 10746 344 1.0 1044.6 0.1X -write timestamps to files 9573 9659 101 1.0 957.3 0.1X -Create a dataset of dates 1245 1260 17 8.0 124.5 0.9X -to_csv(date) 7157 7167 11 1.4 715.7 0.1X -write dates to files 5415 5450 57 1.8 541.5 0.2X +Create a dataset of timestamps 2025 2068 66 4.9 202.5 1.0X +to_csv(timestamp) 22192 22983 879 0.5 2219.2 0.1X +write timestamps to files 15949 16030 72 0.6 1594.9 0.1X +Create a dataset of dates 2200 2234 32 4.5 220.0 0.9X +to_csv(date) 18268 18341 73 0.5 1826.8 0.1X +write dates to files 10495 10722 214 1.0 1049.5 0.2X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 1880 1887 8 5.3 188.0 1.0X -read timestamps from files 27135 27180 43 0.4 2713.5 0.1X -infer timestamps from files 51426 51534 97 0.2 5142.6 0.0X -read date text from files 1618 1622 4 6.2 161.8 1.2X -read date from files 20207 20218 13 0.5 2020.7 0.1X -infer date from files 19418 19479 94 0.5 1941.8 0.1X -timestamp strings 2289 2300 13 4.4 228.9 0.8X -parse timestamps from Dataset[String] 29367 29391 24 0.3 2936.7 0.1X -infer timestamps from Dataset[String] 54782 54902 126 0.2 5478.2 0.0X -date strings 2508 2524 16 4.0 250.8 0.7X -parse dates from Dataset[String] 21884 21902 19 0.5 2188.4 0.1X -from_csv(timestamp) 27188 27723 477 0.4 2718.8 0.1X -from_csv(date) 21137 21191 84 0.5 2113.7 0.1X +read timestamp text from files 6491 6503 18 1.5 649.1 1.0X +read timestamps from files 56069 56795 874 0.2 5606.9 0.1X +infer timestamps from files 113383 114203 825 0.1 11338.3 0.1X +read date text from files 6411 6419 10 1.6 641.1 1.0X +read date from files 46245 46371 138 0.2 4624.5 0.1X +infer date from files 43623 43906 291 0.2 4362.3 0.1X +timestamp strings 4951 4959 7 2.0 495.1 1.3X +parse timestamps from Dataset[String] 65786 66309 663 0.2 6578.6 0.1X +infer timestamps from Dataset[String] 130891 133861 1928 0.1 13089.1 0.0X +date strings 3814 3895 84 2.6 381.4 1.7X +parse dates from Dataset[String] 52259 52960 614 0.2 5225.9 0.1X +from_csv(timestamp) 63013 63306 291 0.2 6301.3 0.1X +from_csv(date) 49840 52352 NaN 0.2 4984.0 0.1X diff --git a/sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt b/sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..d5dcdab6b9 --- /dev/null +++ b/sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt @@ -0,0 +1,59 @@ +================================================================================================ +Int Read/Write +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Int Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Java Array 233 234 0 1406.0 0.7 1.0X +ByteBuffer Unsafe 396 397 0 826.5 1.2 0.6X +ByteBuffer API 603 605 3 543.0 1.8 0.4X +DirectByteBuffer 1189 1196 9 275.6 3.6 0.2X +Unsafe Buffer 321 324 3 1022.0 1.0 0.7X +Column(on heap) 235 236 2 1393.1 0.7 1.0X +Column(off heap) 524 526 1 624.8 1.6 0.4X +Column(off heap direct) 317 318 1 1034.1 1.0 0.7X +UnsafeRow (on heap) 690 693 3 474.8 2.1 0.3X +UnsafeRow (off heap) 642 646 3 510.1 2.0 0.4X +Column On Heap Append 522 527 4 628.0 1.6 0.4X + + +================================================================================================ +Boolean Read/Write +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Boolean Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Bitset 778 780 3 431.1 2.3 1.0X +Byte Array 355 356 1 944.9 1.1 2.2X + + +================================================================================================ +String Read/Write +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +String Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +On Heap 447 453 5 36.6 27.3 1.0X +Off Heap 652 658 4 25.1 39.8 0.7X + + +================================================================================================ +Array Vector Read +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Array Vector Read: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +On Heap Read Size Only 101 102 0 1616.4 0.6 1.0X +Off Heap Read Size Only 305 307 2 536.8 1.9 0.3X +On Heap Read Elements 4255 4256 1 38.5 26.0 0.0X +Off Heap Read Elements 6097 6104 10 26.9 37.2 0.0X + + diff --git a/sql/core/benchmarks/ColumnarBatchBenchmark-results.txt b/sql/core/benchmarks/ColumnarBatchBenchmark-results.txt index 59637162f0..8ae21d7a7e 100644 --- a/sql/core/benchmarks/ColumnarBatchBenchmark-results.txt +++ b/sql/core/benchmarks/ColumnarBatchBenchmark-results.txt @@ -2,58 +2,58 @@ Int Read/Write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Int Read/Write: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Java Array 244 / 244 1342.3 0.7 1.0X -ByteBuffer Unsafe 445 / 445 736.5 1.4 0.5X -ByteBuffer API 2124 / 2125 154.3 6.5 0.1X -DirectByteBuffer 750 / 750 437.2 2.3 0.3X -Unsafe Buffer 234 / 236 1401.3 0.7 1.0X -Column(on heap) 245 / 245 1335.6 0.7 1.0X -Column(off heap) 489 / 489 670.3 1.5 0.5X -Column(off heap direct) 236 / 236 1388.1 0.7 1.0X -UnsafeRow (on heap) 532 / 534 616.0 1.6 0.5X -UnsafeRow (off heap) 564 / 565 580.7 1.7 0.4X -Column On Heap Append 489 / 489 670.6 1.5 0.5X +Int Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Java Array 246 246 0 1333.2 0.8 1.0X +ByteBuffer Unsafe 446 447 1 734.6 1.4 0.6X +ByteBuffer API 2141 2144 4 153.0 6.5 0.1X +DirectByteBuffer 745 745 0 439.9 2.3 0.3X +Unsafe Buffer 237 240 1 1379.7 0.7 1.0X +Column(on heap) 247 247 0 1327.3 0.8 1.0X +Column(off heap) 487 488 1 673.1 1.5 0.5X +Column(off heap direct) 242 243 1 1354.1 0.7 1.0X +UnsafeRow (on heap) 541 543 1 605.4 1.7 0.5X +UnsafeRow (off heap) 581 583 2 563.7 1.8 0.4X +Column On Heap Append 520 521 1 629.8 1.6 0.5X ================================================================================================ Boolean Read/Write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Boolean Read/Write: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Bitset 879 / 879 381.9 2.6 1.0X -Byte Array 794 / 794 422.6 2.4 1.1X +Boolean Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Bitset 883 883 1 380.1 2.6 1.0X +Byte Array 775 777 2 432.9 2.3 1.1X ================================================================================================ String Read/Write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -String Read/Write: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -On Heap 449 / 449 36.5 27.4 1.0X -Off Heap 679 / 679 24.1 41.4 0.7X +String Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +On Heap 463 470 10 35.4 28.3 1.0X +Off Heap 676 677 2 24.2 41.2 0.7X ================================================================================================ Array Vector Read ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Array Vector Read: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -On Heap Read Size Only 713 / 713 229.8 4.4 1.0X -Off Heap Read Size Only 757 / 757 216.5 4.6 0.9X -On Heap Read Elements 3648 / 3650 44.9 22.3 0.2X -Off Heap Read Elements 5263 / 5265 31.1 32.1 0.1X +Array Vector Read: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +On Heap Read Size Only 422 422 0 388.7 2.6 1.0X +Off Heap Read Size Only 259 259 0 633.2 1.6 1.6X +On Heap Read Elements 3932 3960 39 41.7 24.0 0.1X +Off Heap Read Elements 5143 5173 43 31.9 31.4 0.1X diff --git a/sql/core/benchmarks/CompressionSchemeBenchmark-jdk11-results.txt b/sql/core/benchmarks/CompressionSchemeBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..4fd57a9e95 --- /dev/null +++ b/sql/core/benchmarks/CompressionSchemeBenchmark-jdk11-results.txt @@ -0,0 +1,137 @@ +================================================================================================ +Compression Scheme Benchmark +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +BOOLEAN Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 3 3 0 21087.3 0.0 1.0X +RunLengthEncoding(2.514) 739 739 1 90.8 11.0 0.0X +BooleanBitSet(0.125) 378 379 1 177.4 5.6 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +BOOLEAN Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 147 147 1 456.1 2.2 1.0X +RunLengthEncoding 731 732 1 91.8 10.9 0.2X +BooleanBitSet 1410 1411 1 47.6 21.0 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SHORT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 7 7 0 9729.9 0.1 1.0X +RunLengthEncoding(1.491) 1576 1576 1 42.6 23.5 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SHORT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1151 1152 1 58.3 17.2 1.0X +RunLengthEncoding 1619 1621 3 41.4 24.1 0.7X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SHORT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 7 7 0 10135.7 0.1 1.0X +RunLengthEncoding(2.010) 1659 1660 0 40.4 24.7 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SHORT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1151 1151 1 58.3 17.2 1.0X +RunLengthEncoding 1655 1655 0 40.5 24.7 0.7X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +INT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 23 23 0 2952.8 0.3 1.0X +RunLengthEncoding(0.997) 2356 2356 0 28.5 35.1 0.0X +DictionaryEncoding(0.500) 1402 1402 0 47.9 20.9 0.0X +IntDelta(0.250) 213 213 0 315.2 3.2 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +INT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1319 1319 1 50.9 19.7 1.0X +RunLengthEncoding 1803 1806 5 37.2 26.9 0.7X +DictionaryEncoding 931 931 0 72.1 13.9 1.4X +IntDelta 817 821 4 82.2 12.2 1.6X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +INT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 23 23 0 2976.8 0.3 1.0X +RunLengthEncoding(1.337) 2552 2552 1 26.3 38.0 0.0X +DictionaryEncoding(0.501) 1377 1377 0 48.7 20.5 0.0X +IntDelta(0.250) 213 214 2 315.3 3.2 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +INT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1438 1439 1 46.7 21.4 1.0X +RunLengthEncoding 1987 1988 1 33.8 29.6 0.7X +DictionaryEncoding 1249 1250 0 53.7 18.6 1.2X +IntDelta 1135 1136 3 59.2 16.9 1.3X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +LONG Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 45 45 0 1487.9 0.7 1.0X +RunLengthEncoding(0.750) 2496 2496 1 26.9 37.2 0.0X +DictionaryEncoding(0.250) 1433 1433 1 46.8 21.4 0.0X +LongDelta(0.125) 215 215 0 312.6 3.2 0.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +LONG Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1468 1469 1 45.7 21.9 1.0X +RunLengthEncoding 1977 1981 6 33.9 29.5 0.7X +DictionaryEncoding 1248 1250 3 53.8 18.6 1.2X +LongDelta 838 840 2 80.1 12.5 1.8X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +LONG Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 47 47 0 1437.2 0.7 1.0X +RunLengthEncoding(1.002) 2743 2744 0 24.5 40.9 0.0X +DictionaryEncoding(0.251) 2016 2016 0 33.3 30.0 0.0X +LongDelta(0.125) 215 217 5 312.1 3.2 0.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +LONG Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1468 1468 0 45.7 21.9 1.0X +RunLengthEncoding 2020 2021 2 33.2 30.1 0.7X +DictionaryEncoding 1248 1248 0 53.8 18.6 1.2X +LongDelta 1131 1134 4 59.4 16.8 1.3X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +STRING Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 71 71 0 939.6 1.1 1.0X +RunLengthEncoding(0.890) 6050 6052 2 11.1 90.2 0.0X +DictionaryEncoding(0.167) 3723 3725 2 18.0 55.5 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +STRING Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 2804 2815 16 23.9 41.8 1.0X +RunLengthEncoding 3390 3391 1 19.8 50.5 0.8X +DictionaryEncoding 2901 2905 5 23.1 43.2 1.0X + + diff --git a/sql/core/benchmarks/CompressionSchemeBenchmark-results.txt b/sql/core/benchmarks/CompressionSchemeBenchmark-results.txt index caa9378301..3f6fbe35a7 100644 --- a/sql/core/benchmarks/CompressionSchemeBenchmark-results.txt +++ b/sql/core/benchmarks/CompressionSchemeBenchmark-results.txt @@ -2,136 +2,136 @@ Compression Scheme Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -BOOLEAN Encode: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough(1.000) 4 / 4 17998.9 0.1 1.0X -RunLengthEncoding(2.501) 680 / 680 98.7 10.1 0.0X -BooleanBitSet(0.125) 365 / 365 183.9 5.4 0.0X +BOOLEAN Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 3 3 0 21114.6 0.0 1.0X +RunLengthEncoding(2.505) 694 696 4 96.7 10.3 0.0X +BooleanBitSet(0.125) 366 366 0 183.4 5.5 0.0X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -BOOLEAN Decode: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough 144 / 144 466.5 2.1 1.0X -RunLengthEncoding 679 / 679 98.9 10.1 0.2X -BooleanBitSet 1425 / 1431 47.1 21.2 0.1X +BOOLEAN Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 145 145 0 464.2 2.2 1.0X +RunLengthEncoding 735 735 0 91.3 10.9 0.2X +BooleanBitSet 1437 1437 1 46.7 21.4 0.1X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -SHORT Encode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough(1.000) 7 / 7 10115.0 0.1 1.0X -RunLengthEncoding(1.494) 1671 / 1672 40.2 24.9 0.0X +SHORT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 7 7 0 9336.6 0.1 1.0X +RunLengthEncoding(1.494) 1912 1917 7 35.1 28.5 0.0X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -SHORT Decode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough 1128 / 1128 59.5 16.8 1.0X -RunLengthEncoding 1630 / 1633 41.2 24.3 0.7X +SHORT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1104 1104 0 60.8 16.4 1.0X +RunLengthEncoding 1627 1628 0 41.2 24.3 0.7X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -SHORT Encode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough(1.000) 7 / 7 10164.2 0.1 1.0X -RunLengthEncoding(1.989) 1562 / 1563 43.0 23.3 0.0X +SHORT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 7 7 0 9710.6 0.1 1.0X +RunLengthEncoding(2.003) 2021 2027 9 33.2 30.1 0.0X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -SHORT Decode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough 1127 / 1127 59.6 16.8 1.0X -RunLengthEncoding 1629 / 1631 41.2 24.3 0.7X +SHORT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1104 1104 0 60.8 16.5 1.0X +RunLengthEncoding 1621 1621 0 41.4 24.1 0.7X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -INT Encode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough(1.000) 22 / 23 2983.2 0.3 1.0X -RunLengthEncoding(1.003) 2426 / 2427 27.7 36.1 0.0X -DictionaryEncoding(0.500) 958 / 958 70.1 14.3 0.0X -IntDelta(0.250) 286 / 286 235.0 4.3 0.1X +INT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 24 24 0 2854.3 0.4 1.0X +RunLengthEncoding(1.005) 2395 2396 2 28.0 35.7 0.0X +DictionaryEncoding(0.500) 1366 1366 0 49.1 20.3 0.0X +IntDelta(0.250) 286 287 0 234.2 4.3 0.1X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -INT Decode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough 1268 / 1269 52.9 18.9 1.0X -RunLengthEncoding 1906 / 1911 35.2 28.4 0.7X -DictionaryEncoding 981 / 982 68.4 14.6 1.3X -IntDelta 812 / 817 82.6 12.1 1.6X +INT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1248 1248 0 53.8 18.6 1.0X +RunLengthEncoding 1738 1739 2 38.6 25.9 0.7X +DictionaryEncoding 969 970 0 69.2 14.4 1.3X +IntDelta 777 779 1 86.3 11.6 1.6X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -INT Encode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough(1.000) 23 / 23 2926.9 0.3 1.0X -RunLengthEncoding(1.326) 2614 / 2614 25.7 38.9 0.0X -DictionaryEncoding(0.501) 1024 / 1024 65.5 15.3 0.0X -IntDelta(0.250) 286 / 286 234.7 4.3 0.1X +INT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 23 23 0 2874.4 0.3 1.0X +RunLengthEncoding(1.334) 2581 2581 0 26.0 38.5 0.0X +DictionaryEncoding(0.501) 1490 1490 0 45.0 22.2 0.0X +IntDelta(0.250) 286 286 0 234.5 4.3 0.1X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -INT Decode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough 1433 / 1433 46.8 21.4 1.0X -RunLengthEncoding 1923 / 1926 34.9 28.6 0.7X -DictionaryEncoding 1285 / 1285 52.2 19.2 1.1X -IntDelta 1129 / 1137 59.4 16.8 1.3X +INT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1389 1389 0 48.3 20.7 1.0X +RunLengthEncoding 1903 1903 0 35.3 28.4 0.7X +DictionaryEncoding 1231 1232 1 54.5 18.3 1.1X +IntDelta 1103 1108 7 60.8 16.4 1.3X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -LONG Encode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough(1.000) 45 / 45 1495.6 0.7 1.0X -RunLengthEncoding(0.738) 2662 / 2663 25.2 39.7 0.0X -DictionaryEncoding(0.250) 1269 / 1269 52.9 18.9 0.0X -LongDelta(0.125) 450 / 450 149.1 6.7 0.1X +LONG Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 48 48 0 1405.2 0.7 1.0X +RunLengthEncoding(0.757) 2525 2525 1 26.6 37.6 0.0X +DictionaryEncoding(0.250) 1380 1381 1 48.6 20.6 0.0X +LongDelta(0.125) 474 474 0 141.7 7.1 0.1X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -LONG Decode (Lower Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough 1483 / 1483 45.3 22.1 1.0X -RunLengthEncoding 1875 / 1875 35.8 27.9 0.8X -DictionaryEncoding 1213 / 1214 55.3 18.1 1.2X -LongDelta 816 / 817 82.2 12.2 1.8X +LONG Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1348 1349 0 49.8 20.1 1.0X +RunLengthEncoding 1850 1851 2 36.3 27.6 0.7X +DictionaryEncoding 1190 1192 3 56.4 17.7 1.1X +LongDelta 801 801 0 83.8 11.9 1.7X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -LONG Encode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough(1.000) 45 / 45 1489.3 0.7 1.0X -RunLengthEncoding(1.003) 2906 / 2906 23.1 43.3 0.0X -DictionaryEncoding(0.251) 1610 / 1610 41.7 24.0 0.0X -LongDelta(0.125) 451 / 451 148.7 6.7 0.1X +LONG Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 46 46 0 1451.2 0.7 1.0X +RunLengthEncoding(1.003) 2742 2743 1 24.5 40.9 0.0X +DictionaryEncoding(0.251) 1714 1715 0 39.1 25.5 0.0X +LongDelta(0.125) 476 476 0 140.9 7.1 0.1X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -LONG Decode (Higher Skew): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough 1485 / 1485 45.2 22.1 1.0X -RunLengthEncoding 1889 / 1890 35.5 28.2 0.8X -DictionaryEncoding 1215 / 1216 55.2 18.1 1.2X -LongDelta 1107 / 1110 60.6 16.5 1.3X +LONG Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 1362 1363 1 49.3 20.3 1.0X +RunLengthEncoding 1862 1863 1 36.0 27.7 0.7X +DictionaryEncoding 1190 1192 3 56.4 17.7 1.1X +LongDelta 1079 1082 4 62.2 16.1 1.3X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -STRING Encode: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough(1.000) 67 / 68 994.5 1.0 1.0X -RunLengthEncoding(0.894) 5877 / 5882 11.4 87.6 0.0X -DictionaryEncoding(0.167) 3597 / 3602 18.7 53.6 0.0X +STRING Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough(1.000) 67 67 0 994.8 1.0 1.0X +RunLengthEncoding(0.888) 6135 6137 2 10.9 91.4 0.0X +DictionaryEncoding(0.167) 3747 3748 0 17.9 55.8 0.0X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -STRING Decode: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -PassThrough 3243 / 3244 20.7 48.3 1.0X -RunLengthEncoding 3598 / 3601 18.7 53.6 0.9X -DictionaryEncoding 3182 / 3182 21.1 47.4 1.0X +STRING Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +PassThrough 3180 3185 8 21.1 47.4 1.0X +RunLengthEncoding 3658 3660 3 18.3 54.5 0.9X +DictionaryEncoding 3292 3295 4 20.4 49.1 1.0X diff --git a/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt b/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..55cb301dba --- /dev/null +++ b/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt @@ -0,0 +1,252 @@ +================================================================================================ +SQL Single Numeric Column Scan +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 27115 27169 76 0.6 1723.9 1.0X +SQL Json 9061 9124 89 1.7 576.1 3.0X +SQL Parquet Vectorized 196 232 39 80.4 12.4 138.5X +SQL Parquet MR 2187 2216 40 7.2 139.1 12.4X +SQL ORC Vectorized 335 344 5 46.9 21.3 80.9X +SQL ORC MR 1757 1786 42 9.0 111.7 15.4X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Parquet Reader Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ParquetReader Vectorized 201 205 5 78.3 12.8 1.0X +ParquetReader Vectorized -> Row 91 92 1 173.2 5.8 2.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 27969 27972 4 0.6 1778.2 1.0X +SQL Json 10328 10389 87 1.5 656.6 2.7X +SQL Parquet Vectorized 217 237 24 72.5 13.8 128.8X +SQL Parquet MR 2494 2567 103 6.3 158.6 11.2X +SQL ORC Vectorized 310 321 10 50.8 19.7 90.3X +SQL ORC MR 1901 1907 9 8.3 120.9 14.7X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Parquet Reader Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ParquetReader Vectorized 272 280 10 57.8 17.3 1.0X +ParquetReader Vectorized -> Row 144 185 68 109.3 9.1 1.9X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 29507 29532 34 0.5 1876.0 1.0X +SQL Json 10463 10474 16 1.5 665.2 2.8X +SQL Parquet Vectorized 193 204 10 81.3 12.3 152.6X +SQL Parquet MR 2948 2954 7 5.3 187.5 10.0X +SQL ORC Vectorized 268 277 9 58.7 17.0 110.1X +SQL ORC MR 1910 1950 57 8.2 121.4 15.5X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Parquet Reader Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ParquetReader Vectorized 263 278 38 59.7 16.7 1.0X +ParquetReader Vectorized -> Row 259 266 9 60.7 16.5 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 36696 36771 106 0.4 2333.0 1.0X +SQL Json 13496 13520 34 1.2 858.0 2.7X +SQL Parquet Vectorized 282 292 9 55.7 17.9 130.0X +SQL Parquet MR 3358 3383 36 4.7 213.5 10.9X +SQL ORC Vectorized 409 414 5 38.5 26.0 89.7X +SQL ORC MR 2250 2275 35 7.0 143.1 16.3X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Parquet Reader Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ParquetReader Vectorized 360 372 15 43.6 22.9 1.0X +ParquetReader Vectorized -> Row 354 357 5 44.4 22.5 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 30462 30466 5 0.5 1936.7 1.0X +SQL Json 12916 12948 45 1.2 821.2 2.4X +SQL Parquet Vectorized 181 185 5 86.7 11.5 168.0X +SQL Parquet MR 2810 2820 14 5.6 178.7 10.8X +SQL ORC Vectorized 426 430 4 36.9 27.1 71.6X +SQL ORC MR 2106 2112 9 7.5 133.9 14.5X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Parquet Reader Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ParquetReader Vectorized 255 261 7 61.6 16.2 1.0X +ParquetReader Vectorized -> Row 285 288 5 55.1 18.1 0.9X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 36950 36979 41 0.4 2349.2 1.0X +SQL Json 18794 18795 2 0.8 1194.9 2.0X +SQL Parquet Vectorized 279 295 17 56.3 17.8 132.3X +SQL Parquet MR 3933 4025 130 4.0 250.0 9.4X +SQL ORC Vectorized 521 527 6 30.2 33.2 70.9X +SQL ORC MR 2290 2326 51 6.9 145.6 16.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Parquet Reader Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ParquetReader Vectorized 356 365 12 44.2 22.6 1.0X +ParquetReader Vectorized -> Row 350 352 2 45.0 22.2 1.0X + + +================================================================================================ +Int and String Scan +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 26764 26810 65 0.4 2552.4 1.0X +SQL Json 12107 12195 124 0.9 1154.6 2.2X +SQL Parquet Vectorized 2202 2210 10 4.8 210.0 12.2X +SQL Parquet MR 5297 5302 6 2.0 505.2 5.1X +SQL ORC Vectorized 2356 2372 23 4.5 224.7 11.4X +SQL ORC MR 4370 4419 70 2.4 416.8 6.1X + + +================================================================================================ +Repeated String Scan +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 19953 19966 18 0.5 1902.8 1.0X +SQL Json 7151 7220 98 1.5 681.9 2.8X +SQL Parquet Vectorized 692 695 3 15.1 66.0 28.8X +SQL Parquet MR 2859 2943 118 3.7 272.6 7.0X +SQL ORC Vectorized 535 540 5 19.6 51.0 37.3X +SQL ORC MR 2157 2162 8 4.9 205.7 9.3X + + +================================================================================================ +Partitioned Table Scan +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Data column - CSV 46775 46785 13 0.3 2973.9 1.0X +Data column - Json 13891 13893 2 1.1 883.2 3.4X +Data column - Parquet Vectorized 301 306 7 52.3 19.1 155.6X +Data column - Parquet MR 3565 3572 10 4.4 226.7 13.1X +Data column - ORC Vectorized 434 458 36 36.2 27.6 107.7X +Data column - ORC MR 2337 2354 24 6.7 148.6 20.0X +Partition column - CSV 10645 10688 61 1.5 676.8 4.4X +Partition column - Json 10912 10973 87 1.4 693.7 4.3X +Partition column - Parquet Vectorized 93 103 9 169.4 5.9 503.8X +Partition column - Parquet MR 1588 1597 13 9.9 100.9 29.5X +Partition column - ORC Vectorized 92 99 11 170.7 5.9 507.6X +Partition column - ORC MR 1714 1716 3 9.2 109.0 27.3X +Both columns - CSV 46199 46222 32 0.3 2937.3 1.0X +Both columns - Json 17279 17291 18 0.9 1098.6 2.7X +Both columns - Parquet Vectorized 346 355 13 45.4 22.0 135.0X +Both columns - Parquet MR 3883 3908 35 4.1 246.9 12.0X +Both columns - ORC Vectorized 577 618 57 27.3 36.7 81.1X +Both columns - ORC MR 2967 3024 80 5.3 188.7 15.8X + + +================================================================================================ +String with Nulls Scan +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 23623 23731 153 0.4 2252.9 1.0X +SQL Json 13299 13432 187 0.8 1268.3 1.8X +SQL Parquet Vectorized 1464 1466 4 7.2 139.6 16.1X +SQL Parquet MR 7602 7628 37 1.4 724.9 3.1X +ParquetReader Vectorized 1032 1043 15 10.2 98.4 22.9X +SQL ORC Vectorized 1206 1211 7 8.7 115.0 19.6X +SQL ORC MR 4726 4991 374 2.2 450.7 5.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 23715 24152 619 0.4 2261.6 1.0X +SQL Json 10120 10280 226 1.0 965.1 2.3X +SQL Parquet Vectorized 1063 1072 13 9.9 101.4 22.3X +SQL Parquet MR 5460 5464 5 1.9 520.8 4.3X +ParquetReader Vectorized 934 936 4 11.2 89.0 25.4X +SQL ORC Vectorized 1094 1094 0 9.6 104.3 21.7X +SQL ORC MR 3964 4401 618 2.6 378.0 6.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 21348 21472 175 0.5 2035.9 1.0X +SQL Json 5877 5956 112 1.8 560.5 3.6X +SQL Parquet Vectorized 244 256 22 43.0 23.2 87.6X +SQL Parquet MR 3139 3371 328 3.3 299.4 6.8X +ParquetReader Vectorized 238 245 9 44.1 22.7 89.7X +SQL ORC Vectorized 378 383 7 27.7 36.0 56.5X +SQL ORC MR 2234 2315 115 4.7 213.0 9.6X + + +================================================================================================ +Single Column Scan From Wide Columns +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Single Column Scan from 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 4053 4064 16 0.3 3865.4 1.0X +SQL Json 4115 4118 4 0.3 3924.6 1.0X +SQL Parquet Vectorized 72 82 11 14.5 69.0 56.0X +SQL Parquet MR 314 325 18 3.3 299.3 12.9X +SQL ORC Vectorized 80 86 8 13.1 76.2 50.7X +SQL ORC MR 250 253 2 4.2 238.5 16.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Single Column Scan from 50 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 7802 7849 66 0.1 7440.8 1.0X +SQL Json 16640 17481 1190 0.1 15868.8 0.5X +SQL Parquet Vectorized 106 126 31 9.9 101.0 73.7X +SQL Parquet MR 349 358 7 3.0 332.8 22.4X +SQL ORC Vectorized 108 115 10 9.7 102.7 72.5X +SQL ORC MR 284 298 20 3.7 270.5 27.5X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +SQL CSV 12639 12672 47 0.1 12053.5 1.0X +SQL Json 30613 30688 106 0.0 29194.8 0.4X +SQL Parquet Vectorized 145 165 21 7.2 138.3 87.2X +SQL Parquet MR 384 393 9 2.7 366.4 32.9X +SQL ORC Vectorized 129 134 5 8.1 123.2 97.8X +SQL ORC MR 280 319 66 3.7 266.9 45.2X + + diff --git a/sql/core/benchmarks/DataSourceReadBenchmark-results.txt b/sql/core/benchmarks/DataSourceReadBenchmark-results.txt index efb0601cc5..4e8bb019fb 100644 --- a/sql/core/benchmarks/DataSourceReadBenchmark-results.txt +++ b/sql/core/benchmarks/DataSourceReadBenchmark-results.txt @@ -6,109 +6,109 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 23939 24126 265 0.7 1522.0 1.0X -SQL Json 8908 9008 142 1.8 566.4 2.7X -SQL Parquet Vectorized 192 229 36 82.1 12.2 125.0X -SQL Parquet MR 2356 2363 10 6.7 149.8 10.2X -SQL ORC Vectorized 329 347 25 47.9 20.9 72.9X -SQL ORC MR 1711 1747 50 9.2 108.8 14.0X +SQL CSV 23037 23172 191 0.7 1464.7 1.0X +SQL Json 8682 8686 5 1.8 552.0 2.7X +SQL Parquet Vectorized 183 205 32 85.9 11.6 125.8X +SQL Parquet MR 2189 2200 15 7.2 139.2 10.5X +SQL ORC Vectorized 296 306 5 53.1 18.8 77.7X +SQL ORC MR 1705 1717 18 9.2 108.4 13.5X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 194 197 4 81.1 12.3 1.0X -ParquetReader Vectorized -> Row 97 102 13 162.3 6.2 2.0X +ParquetReader Vectorized 195 200 7 80.9 12.4 1.0X +ParquetReader Vectorized -> Row 96 97 2 163.0 6.1 2.0X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 24603 24607 6 0.6 1564.2 1.0X -SQL Json 9587 9652 92 1.6 609.5 2.6X -SQL Parquet Vectorized 227 241 13 69.4 14.4 108.6X -SQL Parquet MR 2432 2441 12 6.5 154.6 10.1X -SQL ORC Vectorized 320 327 8 49.2 20.3 76.9X -SQL ORC MR 1889 1921 46 8.3 120.1 13.0X +SQL CSV 25126 25265 196 0.6 1597.5 1.0X +SQL Json 9442 9445 4 1.7 600.3 2.7X +SQL Parquet Vectorized 228 240 7 69.1 14.5 110.4X +SQL Parquet MR 2432 2445 19 6.5 154.6 10.3X +SQL ORC Vectorized 315 319 6 49.9 20.0 79.8X +SQL ORC MR 1901 1916 21 8.3 120.9 13.2X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 290 294 8 54.3 18.4 1.0X -ParquetReader Vectorized -> Row 252 256 5 62.4 16.0 1.2X +ParquetReader Vectorized 293 302 9 53.6 18.7 1.0X +ParquetReader Vectorized -> Row 264 266 2 59.7 16.8 1.1X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 26742 26743 1 0.6 1700.2 1.0X -SQL Json 10855 10855 0 1.4 690.1 2.5X -SQL Parquet Vectorized 195 202 7 80.8 12.4 137.3X -SQL Parquet MR 2805 2806 0 5.6 178.4 9.5X -SQL ORC Vectorized 376 383 5 41.8 23.9 71.1X -SQL ORC MR 2021 2092 102 7.8 128.5 13.2X +SQL CSV 27419 27443 34 0.6 1743.3 1.0X +SQL Json 9831 9836 8 1.6 625.0 2.8X +SQL Parquet Vectorized 192 198 9 81.8 12.2 142.7X +SQL Parquet MR 2696 2740 62 5.8 171.4 10.2X +SQL ORC Vectorized 329 335 8 47.9 20.9 83.4X +SQL ORC MR 1932 2006 105 8.1 122.8 14.2X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 248 253 5 63.4 15.8 1.0X -ParquetReader Vectorized -> Row 249 251 2 63.1 15.9 1.0X +ParquetReader Vectorized 248 253 6 63.5 15.8 1.0X +ParquetReader Vectorized -> Row 250 256 7 62.9 15.9 1.0X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 34841 34855 20 0.5 2215.1 1.0X -SQL Json 14121 14133 18 1.1 897.8 2.5X -SQL Parquet Vectorized 288 303 17 54.7 18.3 121.2X -SQL Parquet MR 3178 3197 27 4.9 202.0 11.0X -SQL ORC Vectorized 465 476 8 33.8 29.6 74.9X -SQL ORC MR 2255 2260 6 7.0 143.4 15.4X +SQL CSV 34898 34907 14 0.5 2218.7 1.0X +SQL Json 12760 12764 5 1.2 811.3 2.7X +SQL Parquet Vectorized 283 289 5 55.6 18.0 123.3X +SQL Parquet MR 3238 3240 3 4.9 205.9 10.8X +SQL ORC Vectorized 401 405 7 39.2 25.5 87.0X +SQL ORC MR 2274 2290 23 6.9 144.6 15.3X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 344 354 11 45.8 21.8 1.0X -ParquetReader Vectorized -> Row 383 385 3 41.1 24.3 0.9X +ParquetReader Vectorized 339 351 16 46.5 21.5 1.0X +ParquetReader Vectorized -> Row 342 348 13 46.0 21.8 1.0X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 29336 29563 322 0.5 1865.1 1.0X -SQL Json 13452 13544 130 1.2 855.3 2.2X -SQL Parquet Vectorized 186 200 22 84.8 11.8 158.1X -SQL Parquet MR 2752 2815 90 5.7 175.0 10.7X -SQL ORC Vectorized 460 465 6 34.2 29.3 63.7X -SQL ORC MR 2054 2072 26 7.7 130.6 14.3X +SQL CSV 28872 28886 20 0.5 1835.6 1.0X +SQL Json 13360 13377 24 1.2 849.4 2.2X +SQL Parquet Vectorized 181 185 6 86.8 11.5 159.3X +SQL Parquet MR 2645 2651 8 5.9 168.2 10.9X +SQL ORC Vectorized 456 459 5 34.5 29.0 63.4X +SQL ORC MR 2047 2066 26 7.7 130.2 14.1X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 244 246 4 64.6 15.5 1.0X -ParquetReader Vectorized -> Row 247 250 4 63.7 15.7 1.0X +ParquetReader Vectorized 240 246 10 65.5 15.3 1.0X +ParquetReader Vectorized -> Row 245 246 2 64.2 15.6 1.0X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 37812 37897 120 0.4 2404.0 1.0X -SQL Json 19499 19509 15 0.8 1239.7 1.9X -SQL Parquet Vectorized 284 292 10 55.4 18.1 133.2X -SQL Parquet MR 3236 3248 17 4.9 205.7 11.7X -SQL ORC Vectorized 542 558 18 29.0 34.4 69.8X -SQL ORC MR 2273 2298 36 6.9 144.5 16.6X +SQL CSV 36298 36305 10 0.4 2307.7 1.0X +SQL Json 18250 18276 36 0.9 1160.3 2.0X +SQL Parquet Vectorized 278 285 7 56.5 17.7 130.4X +SQL Parquet MR 3144 3146 4 5.0 199.9 11.5X +SQL ORC Vectorized 533 546 16 29.5 33.9 68.1X +SQL ORC MR 2265 2302 53 6.9 144.0 16.0X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 342 352 13 46.0 21.7 1.0X -ParquetReader Vectorized -> Row 341 344 3 46.1 21.7 1.0X +ParquetReader Vectorized 338 346 12 46.6 21.5 1.0X +ParquetReader Vectorized -> Row 338 344 9 46.5 21.5 1.0X ================================================================================================ @@ -119,12 +119,12 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 26777 26806 41 0.4 2553.7 1.0X -SQL Json 13894 14071 251 0.8 1325.0 1.9X -SQL Parquet Vectorized 2351 2404 75 4.5 224.2 11.4X -SQL Parquet MR 5198 5219 29 2.0 495.8 5.2X -SQL ORC Vectorized 2434 2435 1 4.3 232.1 11.0X -SQL ORC MR 4281 4345 91 2.4 408.3 6.3X +SQL CSV 24839 25273 613 0.4 2368.9 1.0X +SQL Json 11861 11869 11 0.9 1131.2 2.1X +SQL Parquet Vectorized 2298 2305 9 4.6 219.2 10.8X +SQL Parquet MR 5045 5053 10 2.1 481.2 4.9X +SQL ORC Vectorized 2391 2405 21 4.4 228.0 10.4X +SQL ORC MR 4561 4645 118 2.3 435.0 5.4X ================================================================================================ @@ -135,12 +135,12 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 15779 16507 1029 0.7 1504.8 1.0X -SQL Json 7866 7877 14 1.3 750.2 2.0X -SQL Parquet Vectorized 820 826 5 12.8 78.2 19.2X -SQL Parquet MR 2646 2658 17 4.0 252.4 6.0X -SQL ORC Vectorized 638 644 7 16.4 60.9 24.7X -SQL ORC MR 2205 2222 25 4.8 210.3 7.2X +SQL CSV 14147 14244 137 0.7 1349.1 1.0X +SQL Json 7289 7306 23 1.4 695.1 1.9X +SQL Parquet Vectorized 818 821 4 12.8 78.0 17.3X +SQL Parquet MR 2562 2570 11 4.1 244.4 5.5X +SQL ORC Vectorized 571 579 8 18.3 54.5 24.8X +SQL ORC MR 2143 2164 31 4.9 204.3 6.6X ================================================================================================ @@ -151,24 +151,24 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column - CSV 38142 38183 58 0.4 2425.0 1.0X -Data column - Json 14664 14667 4 1.1 932.3 2.6X -Data column - Parquet Vectorized 304 318 13 51.8 19.3 125.7X -Data column - Parquet MR 3378 3384 8 4.7 214.8 11.3X -Data column - ORC Vectorized 475 481 7 33.1 30.2 80.3X -Data column - ORC MR 2324 2356 46 6.8 147.7 16.4X -Partition column - CSV 14680 14742 88 1.1 933.3 2.6X -Partition column - Json 11200 11251 73 1.4 712.1 3.4X -Partition column - Parquet Vectorized 102 111 14 154.7 6.5 375.1X -Partition column - Parquet MR 1477 1483 9 10.7 93.9 25.8X -Partition column - ORC Vectorized 100 112 18 157.4 6.4 381.6X -Partition column - ORC MR 1675 1685 15 9.4 106.5 22.8X -Both columns - CSV 41925 41929 6 0.4 2665.5 0.9X -Both columns - Json 15409 15422 18 1.0 979.7 2.5X -Both columns - Parquet Vectorized 351 358 10 44.8 22.3 108.7X -Both columns - Parquet MR 3719 3720 2 4.2 236.4 10.3X -Both columns - ORC Vectorized 609 630 23 25.8 38.7 62.6X -Both columns - ORC MR 2959 2959 1 5.3 188.1 12.9X +Data column - CSV 38652 38680 40 0.4 2457.4 1.0X +Data column - Json 12756 12760 5 1.2 811.0 3.0X +Data column - Parquet Vectorized 304 314 9 51.7 19.3 127.2X +Data column - Parquet MR 3387 3393 9 4.6 215.3 11.4X +Data column - ORC Vectorized 425 436 10 37.0 27.0 91.0X +Data column - ORC MR 2303 2330 38 6.8 146.4 16.8X +Partition column - CSV 11239 11249 14 1.4 714.5 3.4X +Partition column - Json 10477 10479 3 1.5 666.1 3.7X +Partition column - Parquet Vectorized 95 102 9 165.5 6.0 406.7X +Partition column - Parquet MR 1574 1575 1 10.0 100.1 24.6X +Partition column - ORC Vectorized 95 106 20 166.3 6.0 408.5X +Partition column - ORC MR 1682 1693 15 9.4 106.9 23.0X +Both columns - CSV 39146 39203 81 0.4 2488.8 1.0X +Both columns - Json 14675 14691 23 1.1 933.0 2.6X +Both columns - Parquet Vectorized 347 351 3 45.3 22.1 111.4X +Both columns - Parquet MR 3680 3717 52 4.3 234.0 10.5X +Both columns - ORC Vectorized 556 565 8 28.3 35.3 69.6X +Both columns - ORC MR 2909 2923 20 5.4 184.9 13.3X ================================================================================================ @@ -179,37 +179,37 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 19510 19709 282 0.5 1860.6 1.0X -SQL Json 11816 11822 8 0.9 1126.9 1.7X -SQL Parquet Vectorized 1535 1548 18 6.8 146.4 12.7X -SQL Parquet MR 5491 5514 33 1.9 523.6 3.6X -ParquetReader Vectorized 1126 1129 5 9.3 107.4 17.3X -SQL ORC Vectorized 1200 1215 21 8.7 114.5 16.3X -SQL ORC MR 3901 3904 4 2.7 372.1 5.0X +SQL CSV 17457 17740 401 0.6 1664.9 1.0X +SQL Json 12276 12287 16 0.9 1170.7 1.4X +SQL Parquet Vectorized 1525 1539 20 6.9 145.4 11.5X +SQL Parquet MR 5051 5098 66 2.1 481.7 3.5X +ParquetReader Vectorized 1115 1123 12 9.4 106.3 15.7X +SQL ORC Vectorized 1269 1294 37 8.3 121.0 13.8X +SQL ORC MR 3938 3951 17 2.7 375.6 4.4X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 21439 21457 26 0.5 2044.6 1.0X -SQL Json 9653 9669 22 1.1 920.6 2.2X -SQL Parquet Vectorized 1126 1131 8 9.3 107.4 19.0X -SQL Parquet MR 3947 3961 19 2.7 376.4 5.4X -ParquetReader Vectorized 998 1023 36 10.5 95.2 21.5X -SQL ORC Vectorized 1274 1277 4 8.2 121.5 16.8X -SQL ORC MR 3424 3425 1 3.1 326.5 6.3X +SQL CSV 18086 18119 47 0.6 1724.8 1.0X +SQL Json 8484 8851 520 1.2 809.1 2.1X +SQL Parquet Vectorized 1127 1131 5 9.3 107.5 16.0X +SQL Parquet MR 4120 4131 15 2.5 392.9 4.4X +ParquetReader Vectorized 984 1019 49 10.7 93.9 18.4X +SQL ORC Vectorized 1208 1211 4 8.7 115.2 15.0X +SQL ORC MR 3401 3410 13 3.1 324.4 5.3X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 17885 17893 11 0.6 1705.7 1.0X -SQL Json 5201 5210 13 2.0 496.0 3.4X -SQL Parquet Vectorized 261 267 6 40.2 24.9 68.6X -SQL Parquet MR 2841 2853 18 3.7 270.9 6.3X -ParquetReader Vectorized 244 246 3 43.1 23.2 73.4X -SQL ORC Vectorized 465 468 1 22.5 44.4 38.4X -SQL ORC MR 1904 1945 58 5.5 181.6 9.4X +SQL CSV 24825 24970 205 0.4 2367.5 1.0X +SQL Json 9847 9857 14 1.1 939.1 2.5X +SQL Parquet Vectorized 258 261 6 40.7 24.6 96.3X +SQL Parquet MR 3182 3242 85 3.3 303.4 7.8X +ParquetReader Vectorized 241 242 2 43.6 22.9 103.2X +SQL ORC Vectorized 453 456 4 23.1 43.2 54.8X +SQL ORC MR 1917 1927 13 5.5 182.8 12.9X ================================================================================================ @@ -220,33 +220,33 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 3841 3861 28 0.3 3663.1 1.0X -SQL Json 3780 3787 10 0.3 3604.6 1.0X -SQL Parquet Vectorized 83 90 10 12.7 79.0 46.4X -SQL Parquet MR 291 303 18 3.6 277.9 13.2X -SQL ORC Vectorized 93 106 20 11.3 88.8 41.2X -SQL ORC MR 217 224 10 4.8 206.6 17.7X +SQL CSV 5163 5174 16 0.2 4923.5 1.0X +SQL Json 4459 4538 111 0.2 4252.7 1.2X +SQL Parquet Vectorized 78 84 8 13.4 74.7 65.9X +SQL Parquet MR 511 519 9 2.1 486.9 10.1X +SQL ORC Vectorized 86 93 11 12.2 82.1 60.0X +SQL ORC MR 350 359 7 3.0 333.6 14.8X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 50 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 8896 8971 106 0.1 8483.9 1.0X -SQL Json 14731 14773 59 0.1 14048.2 0.6X -SQL Parquet Vectorized 120 146 26 8.8 114.0 74.4X -SQL Parquet MR 330 363 33 3.2 314.4 27.0X -SQL ORC Vectorized 122 130 11 8.6 115.9 73.2X -SQL ORC MR 248 254 9 4.2 237.0 35.8X +SQL CSV 9839 9842 4 0.1 9383.4 1.0X +SQL Json 15887 15889 4 0.1 15150.7 0.6X +SQL Parquet Vectorized 115 125 11 9.1 109.9 85.4X +SQL Parquet MR 666 671 8 1.6 635.4 14.8X +SQL ORC Vectorized 115 120 6 9.1 110.1 85.2X +SQL ORC MR 455 458 3 2.3 433.7 21.6X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 14771 14817 65 0.1 14086.3 1.0X -SQL Json 29677 29787 157 0.0 28302.0 0.5X -SQL Parquet Vectorized 182 191 13 5.8 173.8 81.1X -SQL Parquet MR 1209 1213 5 0.9 1153.1 12.2X -SQL ORC Vectorized 165 176 17 6.3 157.7 89.3X -SQL ORC MR 809 813 4 1.3 771.4 18.3X +SQL CSV 15858 15891 46 0.1 15123.5 1.0X +SQL Json 30200 30256 80 0.0 28800.6 0.5X +SQL Parquet Vectorized 160 165 7 6.5 153.0 98.8X +SQL Parquet MR 682 690 7 1.5 650.3 23.3X +SQL ORC Vectorized 143 150 10 7.4 136.0 111.2X +SQL ORC MR 494 509 15 2.1 471.4 32.1X diff --git a/sql/core/benchmarks/DatasetBenchmark-jdk11-results.txt b/sql/core/benchmarks/DatasetBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..f07fae9121 --- /dev/null +++ b/sql/core/benchmarks/DatasetBenchmark-jdk11-results.txt @@ -0,0 +1,46 @@ +================================================================================================ +Dataset Benchmark +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +back-to-back map long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD 14574 14759 261 6.9 145.7 1.0X +DataFrame 2468 2655 264 40.5 24.7 5.9X +Dataset 3498 3533 50 28.6 35.0 4.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +back-to-back map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD 17877 18133 361 5.6 178.8 1.0X +DataFrame 5968 5991 33 16.8 59.7 3.0X +Dataset 12638 12859 313 7.9 126.4 1.4X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +back-to-back filter Long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD 3399 3464 92 29.4 34.0 1.0X +DataFrame 1609 1628 28 62.2 16.1 2.1X +Dataset 3637 3648 16 27.5 36.4 0.9X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +back-to-back filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD 4850 4859 13 20.6 48.5 1.0X +DataFrame 211 244 21 472.9 2.1 22.9X +Dataset 5864 6126 372 17.1 58.6 0.8X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +aggregate: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD sum 4821 4914 131 20.7 48.2 1.0X +DataFrame sum 71 83 8 1412.4 0.7 68.1X +Dataset sum using Aggregator 6001 6012 16 16.7 60.0 0.8X +Dataset complex Aggregator 10247 10455 294 9.8 102.5 0.5X + + diff --git a/sql/core/benchmarks/DatasetBenchmark-results.txt b/sql/core/benchmarks/DatasetBenchmark-results.txt index dcc190eb45..2774f14664 100644 --- a/sql/core/benchmarks/DatasetBenchmark-results.txt +++ b/sql/core/benchmarks/DatasetBenchmark-results.txt @@ -2,45 +2,45 @@ Dataset Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -back-to-back map long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -RDD 11800 / 12042 8.5 118.0 1.0X -DataFrame 1927 / 2189 51.9 19.3 6.1X -Dataset 2483 / 2605 40.3 24.8 4.8X +back-to-back map long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD 12720 12777 80 7.9 127.2 1.0X +DataFrame 2242 2501 366 44.6 22.4 5.7X +Dataset 3040 3174 189 32.9 30.4 4.2X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -back-to-back map: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -RDD 16286 / 16301 6.1 162.9 1.0X -DataFrame 8101 / 8104 12.3 81.0 2.0X -Dataset 17445 / 17811 5.7 174.4 0.9X +back-to-back map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD 15865 15922 82 6.3 158.6 1.0X +DataFrame 8423 8476 75 11.9 84.2 1.9X +Dataset 17180 18142 1361 5.8 171.8 0.9X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -back-to-back filter Long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -RDD 2971 / 3184 33.7 29.7 1.0X -DataFrame 1243 / 1296 80.5 12.4 2.4X -Dataset 3062 / 3091 32.7 30.6 1.0X +back-to-back filter Long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD 2928 3009 114 34.1 29.3 1.0X +DataFrame 1386 1427 59 72.2 13.9 2.1X +Dataset 3448 3451 5 29.0 34.5 0.8X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -back-to-back filter: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -RDD 5253 / 5269 19.0 52.5 1.0X -DataFrame 211 / 234 473.4 2.1 24.9X -Dataset 9550 / 9552 10.5 95.5 0.6X +back-to-back filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD 5476 5483 10 18.3 54.8 1.0X +DataFrame 209 235 23 479.1 2.1 26.2X +Dataset 9433 9549 163 10.6 94.3 0.6X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -aggregate: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -RDD sum 5086 / 5108 19.7 50.9 1.0X -DataFrame sum 65 / 73 1548.9 0.6 78.8X -Dataset sum using Aggregator 9024 / 9320 11.1 90.2 0.6X -Dataset complex Aggregator 15079 / 15171 6.6 150.8 0.3X +aggregate: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +RDD sum 5146 5239 132 19.4 51.5 1.0X +DataFrame sum 84 99 15 1196.9 0.8 61.6X +Dataset sum using Aggregator 8944 9021 109 11.2 89.4 0.6X +Dataset complex Aggregator 12832 13141 436 7.8 128.3 0.4X diff --git a/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt b/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..27cb1008fa --- /dev/null +++ b/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt @@ -0,0 +1,429 @@ +================================================================================================ +Extract components +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +cast to timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +cast to timestamp wholestage off 460 486 36 21.7 46.0 1.0X +cast to timestamp wholestage on 412 455 70 24.3 41.2 1.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +year of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +year of timestamp wholestage off 1351 1351 1 7.4 135.1 1.0X +year of timestamp wholestage on 1277 1312 47 7.8 127.7 1.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +quarter of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +quarter of timestamp wholestage off 1591 1604 19 6.3 159.1 1.0X +quarter of timestamp wholestage on 1583 1600 12 6.3 158.3 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +month of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +month of timestamp wholestage off 1263 1268 7 7.9 126.3 1.0X +month of timestamp wholestage on 1281 1316 46 7.8 128.1 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +weekofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +weekofyear of timestamp wholestage off 1756 1757 1 5.7 175.6 1.0X +weekofyear of timestamp wholestage on 1748 1762 15 5.7 174.8 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +day of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +day of timestamp wholestage off 1250 1253 4 8.0 125.0 1.0X +day of timestamp wholestage on 1270 1285 13 7.9 127.0 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +dayofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +dayofyear of timestamp wholestage off 1295 1303 12 7.7 129.5 1.0X +dayofyear of timestamp wholestage on 1294 1308 16 7.7 129.4 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +dayofmonth of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +dayofmonth of timestamp wholestage off 1277 1311 48 7.8 127.7 1.0X +dayofmonth of timestamp wholestage on 1270 1288 24 7.9 127.0 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +dayofweek of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +dayofweek of timestamp wholestage off 1472 1472 0 6.8 147.2 1.0X +dayofweek of timestamp wholestage on 1434 1437 4 7.0 143.4 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +weekday of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +weekday of timestamp wholestage off 1363 1372 13 7.3 136.3 1.0X +weekday of timestamp wholestage on 1362 1368 3 7.3 136.2 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +hour of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +hour of timestamp wholestage off 748 753 7 13.4 74.8 1.0X +hour of timestamp wholestage on 749 756 9 13.4 74.9 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +minute of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +minute of timestamp wholestage off 722 725 4 13.9 72.2 1.0X +minute of timestamp wholestage on 750 754 4 13.3 75.0 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +second of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +second of timestamp wholestage off 614 620 8 16.3 61.4 1.0X +second of timestamp wholestage on 611 617 5 16.4 61.1 1.0X + + +================================================================================================ +Current date and time +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +current_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +current_date wholestage off 291 298 10 34.4 29.1 1.0X +current_date wholestage on 303 316 13 33.0 30.3 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +current_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +current_timestamp wholestage off 328 355 39 30.5 32.8 1.0X +current_timestamp wholestage on 309 497 387 32.4 30.9 1.1X + + +================================================================================================ +Date arithmetic +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +cast to date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +cast to date wholestage off 1094 1103 12 9.1 109.4 1.0X +cast to date wholestage on 1105 1111 5 9.0 110.5 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +last_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +last_day wholestage off 1258 1258 0 7.9 125.8 1.0X +last_day wholestage on 1279 1289 9 7.8 127.9 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +next_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +next_day wholestage off 1148 1152 7 8.7 114.8 1.0X +next_day wholestage on 1148 1152 4 8.7 114.8 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_add: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_add wholestage off 1069 1074 6 9.4 106.9 1.0X +date_add wholestage on 1087 1091 4 9.2 108.7 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_sub: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_sub wholestage off 1076 1076 1 9.3 107.6 1.0X +date_sub wholestage on 1086 1094 7 9.2 108.6 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +add_months: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +add_months wholestage off 1442 1442 1 6.9 144.2 1.0X +add_months wholestage on 1406 1426 12 7.1 140.6 1.0X + + +================================================================================================ +Formatting dates +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +format date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +format date wholestage off 5082 5179 138 2.0 508.2 1.0X +format date wholestage on 4899 4904 6 2.0 489.9 1.0X + + +================================================================================================ +Formatting timestamps +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +from_unixtime: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +from_unixtime wholestage off 7148 7170 31 1.4 714.8 1.0X +from_unixtime wholestage on 7228 7235 9 1.4 722.8 1.0X + + +================================================================================================ +Convert timestamps +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +from_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +from_utc_timestamp wholestage off 982 990 11 10.2 98.2 1.0X +from_utc_timestamp wholestage on 1053 1058 5 9.5 105.3 0.9X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to_utc_timestamp wholestage off 1063 1075 16 9.4 106.3 1.0X +to_utc_timestamp wholestage on 1121 1136 15 8.9 112.1 0.9X + + +================================================================================================ +Intervals +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +cast interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +cast interval wholestage off 356 374 25 28.1 35.6 1.0X +cast interval wholestage on 341 353 14 29.3 34.1 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +datediff: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +datediff wholestage off 1883 1898 22 5.3 188.3 1.0X +datediff wholestage on 1854 1862 8 5.4 185.4 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +months_between: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +months_between wholestage off 1989 1996 10 5.0 198.9 1.0X +months_between wholestage on 2006 2041 36 5.0 200.6 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +window: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +window wholestage off 2761 2820 83 0.4 2761.1 1.0X +window wholestage on 47075 47156 75 0.0 47075.0 0.1X + + +================================================================================================ +Truncation +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc YEAR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc YEAR wholestage off 916 919 5 10.9 91.6 1.0X +date_trunc YEAR wholestage on 902 904 2 11.1 90.2 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc YYYY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc YYYY wholestage off 909 915 9 11.0 90.9 1.0X +date_trunc YYYY wholestage on 902 909 5 11.1 90.2 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc YY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc YY wholestage off 916 925 12 10.9 91.6 1.0X +date_trunc YY wholestage on 903 908 4 11.1 90.3 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc MON: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc MON wholestage off 921 928 11 10.9 92.1 1.0X +date_trunc MON wholestage on 907 912 4 11.0 90.7 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc MONTH: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc MONTH wholestage off 923 928 7 10.8 92.3 1.0X +date_trunc MONTH wholestage on 902 911 9 11.1 90.2 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc MM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc MM wholestage off 922 924 3 10.8 92.2 1.0X +date_trunc MM wholestage on 908 914 7 11.0 90.8 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc DAY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc DAY wholestage off 644 665 30 15.5 64.4 1.0X +date_trunc DAY wholestage on 632 636 7 15.8 63.2 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc DD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc DD wholestage off 626 636 14 16.0 62.6 1.0X +date_trunc DD wholestage on 635 640 5 15.8 63.5 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc HOUR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc HOUR wholestage off 652 656 5 15.3 65.2 1.0X +date_trunc HOUR wholestage on 644 648 5 15.5 64.4 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc MINUTE: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc MINUTE wholestage off 617 618 2 16.2 61.7 1.0X +date_trunc MINUTE wholestage on 621 625 4 16.1 62.1 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc SECOND: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc SECOND wholestage off 631 631 0 15.8 63.1 1.0X +date_trunc SECOND wholestage on 625 630 8 16.0 62.5 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc WEEK: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc WEEK wholestage off 760 761 1 13.2 76.0 1.0X +date_trunc WEEK wholestage on 760 766 5 13.2 76.0 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc QUARTER: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc QUARTER wholestage off 1656 1657 1 6.0 165.6 1.0X +date_trunc QUARTER wholestage on 1648 1678 36 6.1 164.8 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc year: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc year wholestage off 309 309 1 32.4 30.9 1.0X +trunc year wholestage on 310 315 6 32.3 31.0 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc yyyy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc yyyy wholestage off 310 310 1 32.3 31.0 1.0X +trunc yyyy wholestage on 310 313 2 32.3 31.0 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc yy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc yy wholestage off 307 308 2 32.6 30.7 1.0X +trunc yy wholestage on 310 313 3 32.2 31.0 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc mon: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc mon wholestage off 308 317 12 32.5 30.8 1.0X +trunc mon wholestage on 309 316 7 32.3 30.9 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc month: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc month wholestage off 306 307 2 32.7 30.6 1.0X +trunc month wholestage on 309 314 6 32.4 30.9 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc mm: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc mm wholestage off 308 308 0 32.5 30.8 1.0X +trunc mm wholestage on 309 325 11 32.4 30.9 1.0X + + +================================================================================================ +Parsing +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to timestamp str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to timestamp str wholestage off 170 170 1 5.9 170.0 1.0X +to timestamp str wholestage on 160 165 4 6.2 160.2 1.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to_timestamp wholestage off 1727 1730 4 0.6 1727.1 1.0X +to_timestamp wholestage on 1775 1793 19 0.6 1774.9 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to_unix_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to_unix_timestamp wholestage off 1760 1765 6 0.6 1760.4 1.0X +to_unix_timestamp wholestage on 1756 1763 9 0.6 1756.0 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to date str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to date str wholestage off 159 160 0 6.3 159.4 1.0X +to date str wholestage on 156 162 7 6.4 156.2 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to_date wholestage off 2509 2511 3 0.4 2509.2 1.0X +to_date wholestage on 2500 2514 9 0.4 2499.8 1.0X + + +================================================================================================ +Conversion from/to external types +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +To/from java.sql.Timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +From java.sql.Timestamp 353 356 5 14.2 70.5 1.0X +Collect longs 1561 1864 476 3.2 312.2 0.2X +Collect timestamps 2010 2182 149 2.5 402.0 0.2X + + diff --git a/sql/core/benchmarks/DateTimeBenchmark-results.txt b/sql/core/benchmarks/DateTimeBenchmark-results.txt index 7d562544dd..32578f6573 100644 --- a/sql/core/benchmarks/DateTimeBenchmark-results.txt +++ b/sql/core/benchmarks/DateTimeBenchmark-results.txt @@ -2,424 +2,428 @@ Extract components ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -cast to timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -cast to timestamp wholestage off 275 / 287 36.4 27.5 1.0X -cast to timestamp wholestage on 243 / 253 41.2 24.3 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +cast to timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +cast to timestamp wholestage off 408 434 37 24.5 40.8 1.0X +cast to timestamp wholestage on 363 372 6 27.6 36.3 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -year of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -year of timestamp wholestage off 661 / 667 15.1 66.1 1.0X -year of timestamp wholestage on 659 / 669 15.2 65.9 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +year of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +year of timestamp wholestage off 1317 1327 14 7.6 131.7 1.0X +year of timestamp wholestage on 1258 1308 79 8.0 125.8 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -quarter of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -quarter of timestamp wholestage off 820 / 822 12.2 82.0 1.0X -quarter of timestamp wholestage on 768 / 776 13.0 76.8 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +quarter of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +quarter of timestamp wholestage off 1464 1490 37 6.8 146.4 1.0X +quarter of timestamp wholestage on 1389 1404 13 7.2 138.9 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -month of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -month of timestamp wholestage off 636 / 638 15.7 63.6 1.0X -month of timestamp wholestage on 648 / 654 15.4 64.8 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +month of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +month of timestamp wholestage off 1239 1245 7 8.1 123.9 1.0X +month of timestamp wholestage on 1241 1253 8 8.1 124.1 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -weekofyear of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -weekofyear of timestamp wholestage off 1093 / 1097 9.2 109.3 1.0X -weekofyear of timestamp wholestage on 1101 / 1107 9.1 110.1 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +weekofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +weekofyear of timestamp wholestage off 1896 1899 4 5.3 189.6 1.0X +weekofyear of timestamp wholestage on 1876 1885 6 5.3 187.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -day of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -day of timestamp wholestage off 643 / 644 15.6 64.3 1.0X -day of timestamp wholestage on 655 / 657 15.3 65.5 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +day of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +day of timestamp wholestage off 1234 1235 1 8.1 123.4 1.0X +day of timestamp wholestage on 1221 1231 8 8.2 122.1 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -dayofyear of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -dayofyear of timestamp wholestage off 681 / 692 14.7 68.1 1.0X -dayofyear of timestamp wholestage on 675 / 680 14.8 67.5 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +dayofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +dayofyear of timestamp wholestage off 1269 1275 8 7.9 126.9 1.0X +dayofyear of timestamp wholestage on 1266 1277 9 7.9 126.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -dayofmonth of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -dayofmonth of timestamp wholestage off 656 / 657 15.2 65.6 1.0X -dayofmonth of timestamp wholestage on 651 / 658 15.4 65.1 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +dayofmonth of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +dayofmonth of timestamp wholestage off 1236 1238 2 8.1 123.6 1.0X +dayofmonth of timestamp wholestage on 1223 1235 10 8.2 122.3 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -dayofweek of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -dayofweek of timestamp wholestage off 775 / 776 12.9 77.5 1.0X -dayofweek of timestamp wholestage on 777 / 781 12.9 77.7 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +dayofweek of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +dayofweek of timestamp wholestage off 1408 1409 2 7.1 140.8 1.0X +dayofweek of timestamp wholestage on 1393 1418 38 7.2 139.3 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -weekday of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -weekday of timestamp wholestage off 737 / 737 13.6 73.7 1.0X -weekday of timestamp wholestage on 737 / 739 13.6 73.7 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +weekday of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +weekday of timestamp wholestage off 1339 1348 12 7.5 133.9 1.0X +weekday of timestamp wholestage on 1329 1341 22 7.5 132.9 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -hour of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -hour of timestamp wholestage off 425 / 426 23.5 42.5 1.0X -hour of timestamp wholestage on 430 / 434 23.2 43.0 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +hour of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +hour of timestamp wholestage off 359 366 10 27.9 35.9 1.0X +hour of timestamp wholestage on 344 354 11 29.1 34.4 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -minute of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -minute of timestamp wholestage off 430 / 439 23.3 43.0 1.0X -minute of timestamp wholestage on 436 / 438 23.0 43.6 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +minute of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +minute of timestamp wholestage off 343 343 0 29.1 34.3 1.0X +minute of timestamp wholestage on 336 339 6 29.8 33.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -second of timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -second of timestamp wholestage off 413 / 413 24.2 41.3 1.0X -second of timestamp wholestage on 413 / 425 24.2 41.3 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +second of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +second of timestamp wholestage off 367 383 23 27.2 36.7 1.0X +second of timestamp wholestage on 335 341 6 29.8 33.5 1.1X ================================================================================================ Current date and time ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -current_date: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -current_date wholestage off 205 / 206 48.7 20.5 1.0X -current_date wholestage on 219 / 224 45.8 21.9 0.9X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +current_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +current_date wholestage off 284 286 2 35.2 28.4 1.0X +current_date wholestage on 286 297 18 35.0 28.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -current_timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -current_timestamp wholestage off 212 / 213 47.3 21.2 1.0X -current_timestamp wholestage on 202 / 205 49.6 20.2 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +current_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +current_timestamp wholestage off 291 336 65 34.4 29.1 1.0X +current_timestamp wholestage on 279 290 11 35.9 27.9 1.0X ================================================================================================ Date arithmetic ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -cast to date: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -cast to date wholestage off 459 / 462 21.8 45.9 1.0X -cast to date wholestage on 493 / 500 20.3 49.3 0.9X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +cast to date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +cast to date wholestage off 1069 1069 0 9.4 106.9 1.0X +cast to date wholestage on 1037 1043 7 9.6 103.7 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -last_day: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -last_day wholestage off 680 / 686 14.7 68.0 1.0X -last_day wholestage on 671 / 681 14.9 67.1 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +last_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +last_day wholestage off 1275 1287 18 7.8 127.5 1.0X +last_day wholestage on 1257 1267 10 8.0 125.7 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -next_day: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -next_day wholestage off 532 / 533 18.8 53.2 1.0X -next_day wholestage on 576 / 580 17.4 57.6 0.9X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +next_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +next_day wholestage off 1114 1116 2 9.0 111.4 1.0X +next_day wholestage on 1077 1081 7 9.3 107.7 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_add: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_add wholestage off 445 / 446 22.5 44.5 1.0X -date_add wholestage on 455 / 457 22.0 45.5 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_add: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_add wholestage off 1056 1058 2 9.5 105.6 1.0X +date_add wholestage on 1043 1047 3 9.6 104.3 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_sub: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_sub wholestage off 454 / 457 22.0 45.4 1.0X -date_sub wholestage on 455 / 458 22.0 45.5 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_sub: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_sub wholestage off 1045 1049 5 9.6 104.5 1.0X +date_sub wholestage on 1044 1052 16 9.6 104.4 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -add_months: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -add_months wholestage off 898 / 900 11.1 89.8 1.0X -add_months wholestage on 894 / 909 11.2 89.4 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +add_months: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +add_months wholestage off 1379 1384 7 7.3 137.9 1.0X +add_months wholestage on 1356 1364 6 7.4 135.6 1.0X ================================================================================================ Formatting dates ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -format date: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -format date wholestage off 4787 / 4839 2.1 478.7 1.0X -format date wholestage on 4736 / 4802 2.1 473.6 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +format date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +format date wholestage off 5436 5538 144 1.8 543.6 1.0X +format date wholestage on 5283 5295 16 1.9 528.3 1.0X ================================================================================================ Formatting timestamps ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -from_unixtime: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -from_unixtime wholestage off 7136 / 7163 1.4 713.6 1.0X -from_unixtime wholestage on 7144 / 7174 1.4 714.4 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +from_unixtime: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +from_unixtime wholestage off 8980 8998 26 1.1 898.0 1.0X +from_unixtime wholestage on 8921 8939 19 1.1 892.1 1.0X ================================================================================================ Convert timestamps ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -from_utc_timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -from_utc_timestamp wholestage off 880 / 888 11.4 88.0 1.0X -from_utc_timestamp wholestage on 841 / 854 11.9 84.1 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +from_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +from_utc_timestamp wholestage off 726 736 15 13.8 72.6 1.0X +from_utc_timestamp wholestage on 701 710 16 14.3 70.1 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -to_utc_timestamp: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -to_utc_timestamp wholestage off 879 / 884 11.4 87.9 1.0X -to_utc_timestamp wholestage on 862 / 876 11.6 86.2 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to_utc_timestamp wholestage off 1234 1240 8 8.1 123.4 1.0X +to_utc_timestamp wholestage on 757 770 15 13.2 75.7 1.6X ================================================================================================ Intervals ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -cast interval: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -cast interval wholestage off 242 / 250 41.3 24.2 1.0X -cast interval wholestage on 221 / 223 45.3 22.1 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +cast interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +cast interval wholestage off 327 328 2 30.6 32.7 1.0X +cast interval wholestage on 299 307 13 33.5 29.9 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -datediff: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -datediff wholestage off 697 / 698 14.3 69.7 1.0X -datediff wholestage on 680 / 683 14.7 68.0 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +datediff: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +datediff wholestage off 1865 1872 10 5.4 186.5 1.0X +datediff wholestage on 1815 1821 7 5.5 181.5 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -months_between: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -months_between wholestage off 1675 / 1677 6.0 167.5 1.0X -months_between wholestage on 1636 / 1649 6.1 163.6 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +months_between: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +months_between wholestage off 1524 1525 1 6.6 152.4 1.0X +months_between wholestage on 1511 1518 11 6.6 151.1 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -window: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -window wholestage off 1600 / 1627 0.6 1599.7 1.0X -window wholestage on 19480 / 19530 0.1 19479.6 0.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +window: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +window wholestage off 2441 2519 111 0.4 2440.7 1.0X +window wholestage on 46149 46165 16 0.0 46149.1 0.1X ================================================================================================ Truncation ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc YEAR: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc YEAR wholestage off 863 / 864 11.6 86.3 1.0X -date_trunc YEAR wholestage on 812 / 814 12.3 81.2 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc YEAR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc YEAR wholestage off 773 777 6 12.9 77.3 1.0X +date_trunc YEAR wholestage on 720 733 21 13.9 72.0 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc YYYY: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc YYYY wholestage off 865 / 926 11.6 86.5 1.0X -date_trunc YYYY wholestage on 811 / 820 12.3 81.1 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc YYYY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc YYYY wholestage off 753 754 1 13.3 75.3 1.0X +date_trunc YYYY wholestage on 721 725 3 13.9 72.1 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc YY: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc YY wholestage off 863 / 867 11.6 86.3 1.0X -date_trunc YY wholestage on 810 / 822 12.3 81.0 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc YY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc YY wholestage off 759 762 4 13.2 75.9 1.0X +date_trunc YY wholestage on 727 731 3 13.8 72.7 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc MON: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc MON wholestage off 917 / 921 10.9 91.7 1.0X -date_trunc MON wholestage on 857 / 860 11.7 85.7 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc MON: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc MON wholestage off 728 731 4 13.7 72.8 1.0X +date_trunc MON wholestage on 717 728 17 13.9 71.7 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc MONTH: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc MONTH wholestage off 919 / 919 10.9 91.9 1.0X -date_trunc MONTH wholestage on 862 / 863 11.6 86.2 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc MONTH: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc MONTH wholestage off 728 729 1 13.7 72.8 1.0X +date_trunc MONTH wholestage on 716 719 2 14.0 71.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc MM: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc MM wholestage off 923 / 924 10.8 92.3 1.0X -date_trunc MM wholestage on 855 / 859 11.7 85.5 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc MM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc MM wholestage off 725 732 9 13.8 72.5 1.0X +date_trunc MM wholestage on 721 728 6 13.9 72.1 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc DAY: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc DAY wholestage off 444 / 444 22.5 44.4 1.0X -date_trunc DAY wholestage on 404 / 406 24.7 40.4 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc DAY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc DAY wholestage off 515 520 7 19.4 51.5 1.0X +date_trunc DAY wholestage on 475 484 8 21.1 47.5 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc DD: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc DD wholestage off 445 / 446 22.5 44.5 1.0X -date_trunc DD wholestage on 404 / 406 24.7 40.4 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc DD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc DD wholestage off 515 520 7 19.4 51.5 1.0X +date_trunc DD wholestage on 471 484 9 21.2 47.1 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc HOUR: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc HOUR wholestage off 462 / 464 21.6 46.2 1.0X -date_trunc HOUR wholestage on 416 / 422 24.1 41.6 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc HOUR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc HOUR wholestage off 504 504 1 19.9 50.4 1.0X +date_trunc HOUR wholestage on 465 471 5 21.5 46.5 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc MINUTE: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc MINUTE wholestage off 294 / 294 34.0 29.4 1.0X -date_trunc MINUTE wholestage on 258 / 266 38.8 25.8 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc MINUTE: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc MINUTE wholestage off 485 488 4 20.6 48.5 1.0X +date_trunc MINUTE wholestage on 452 458 6 22.1 45.2 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc SECOND: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc SECOND wholestage off 292 / 295 34.2 29.2 1.0X -date_trunc SECOND wholestage on 271 / 276 36.9 27.1 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc SECOND: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc SECOND wholestage off 483 484 1 20.7 48.3 1.0X +date_trunc SECOND wholestage on 447 453 5 22.4 44.7 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc WEEK: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc WEEK wholestage off 739 / 740 13.5 73.9 1.0X -date_trunc WEEK wholestage on 712 / 715 14.0 71.2 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc WEEK: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc WEEK wholestage off 615 617 2 16.3 61.5 1.0X +date_trunc WEEK wholestage on 576 586 11 17.4 57.6 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -date_trunc QUARTER: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -date_trunc QUARTER wholestage off 1465 / 1467 6.8 146.5 1.0X -date_trunc QUARTER wholestage on 1419 / 1423 7.0 141.9 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +date_trunc QUARTER: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +date_trunc QUARTER wholestage off 1512 1513 1 6.6 151.2 1.0X +date_trunc QUARTER wholestage on 1482 1494 11 6.7 148.2 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -trunc year: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -trunc year wholestage off 222 / 222 45.0 22.2 1.0X -trunc year wholestage on 207 / 214 48.3 20.7 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc year: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc year wholestage off 342 343 1 29.2 34.2 1.0X +trunc year wholestage on 301 304 2 33.3 30.1 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -trunc yyyy: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -trunc yyyy wholestage off 221 / 225 45.2 22.1 1.0X -trunc yyyy wholestage on 208 / 212 48.0 20.8 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc yyyy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc yyyy wholestage off 321 323 2 31.1 32.1 1.0X +trunc yyyy wholestage on 303 305 2 33.0 30.3 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -trunc yy: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -trunc yy wholestage off 221 / 222 45.3 22.1 1.0X -trunc yy wholestage on 208 / 210 48.0 20.8 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc yy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc yy wholestage off 314 325 15 31.8 31.4 1.0X +trunc yy wholestage on 299 307 10 33.4 29.9 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -trunc mon: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -trunc mon wholestage off 231 / 239 43.3 23.1 1.0X -trunc mon wholestage on 208 / 214 48.0 20.8 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc mon: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc mon wholestage off 311 312 2 32.2 31.1 1.0X +trunc mon wholestage on 300 307 6 33.3 30.0 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -trunc month: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -trunc month wholestage off 222 / 222 45.1 22.2 1.0X -trunc month wholestage on 208 / 224 48.1 20.8 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc month: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc month wholestage off 312 314 2 32.1 31.2 1.0X +trunc month wholestage on 299 300 1 33.5 29.9 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -trunc mm: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -trunc mm wholestage off 222 / 226 45.1 22.2 1.0X -trunc mm wholestage on 208 / 216 48.0 20.8 1.1X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +trunc mm: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +trunc mm wholestage off 308 316 11 32.5 30.8 1.0X +trunc mm wholestage on 298 301 2 33.6 29.8 1.0X ================================================================================================ Parsing ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -to timestamp str: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -to timestamp str wholestage off 165 / 166 6.1 164.7 1.0X -to timestamp str wholestage on 160 / 163 6.2 160.5 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to timestamp str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to timestamp str wholestage off 228 232 5 4.4 228.3 1.0X +to timestamp str wholestage on 213 214 2 4.7 212.9 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_timestamp wholestage off 1308 1353 64 0.8 1307.9 1.0X -to_timestamp wholestage on 1197 1230 21 0.8 1197.0 1.1X +to_timestamp wholestage off 1850 1850 0 0.5 1850.0 1.0X +to_timestamp wholestage on 1877 1899 27 0.5 1876.8 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_unix_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_unix_timestamp wholestage off 1221 1224 4 0.8 1221.0 1.0X -to_unix_timestamp wholestage on 1224 1228 4 0.8 1223.8 1.0X +to_unix_timestamp wholestage off 1883 1886 4 0.5 1882.7 1.0X +to_unix_timestamp wholestage on 1817 1831 17 0.6 1817.3 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -to date str: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -to date str wholestage off 155 / 157 6.4 155.4 1.0X -to date str wholestage on 154 / 156 6.5 154.3 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to date str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to date str wholestage off 212 212 1 4.7 211.8 1.0X +to date str wholestage on 206 208 2 4.8 206.3 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.3 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz -to_date: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -to_date wholestage off 1477 / 1479 0.7 1477.3 1.0X -to_date wholestage on 1468 / 1473 0.7 1468.2 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +to_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +to_date wholestage off 2334 2335 0 0.4 2334.3 1.0X +to_date wholestage on 2224 2236 13 0.4 2224.2 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +================================================================================================ +Conversion from/to external types +================================================================================================ + +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz To/from java.sql.Timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -From java.sql.Timestamp 283 301 19 17.7 56.6 1.0X -Collect longs 1048 1087 36 4.8 209.6 0.3X -Collect timestamps 1425 1479 56 3.5 285.1 0.2X +From java.sql.Timestamp 271 274 3 18.4 54.2 1.0X +Collect longs 1386 1925 681 3.6 277.1 0.2X +Collect timestamps 1961 2169 331 2.5 392.2 0.1X diff --git a/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-jdk11-results.txt b/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..4f50a894e5 --- /dev/null +++ b/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-jdk11-results.txt @@ -0,0 +1,45 @@ +================================================================================================ +WITHOUT SPILL +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Array with 100000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ArrayBuffer 5371 5392 30 19.1 52.5 1.0X +ExternalAppendOnlyUnsafeRowArray 6724 6778 77 15.2 65.7 0.8X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Array with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ArrayBuffer 9120 9121 1 28.7 34.8 1.0X +ExternalAppendOnlyUnsafeRowArray 37713 37739 38 7.0 143.9 0.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Array with 30000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ArrayBuffer 18037 18052 21 27.3 36.7 1.0X +ExternalAppendOnlyUnsafeRowArray 34726 34771 63 14.2 70.7 0.5X + + +================================================================================================ +WITH SPILL +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Spilling with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +UnsafeExternalSorter 29668 29676 11 8.8 113.2 1.0X +ExternalAppendOnlyUnsafeRowArray 12658 12663 6 20.7 48.3 2.3X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Spilling with 10000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +UnsafeExternalSorter 12 12 0 13.8 72.7 1.0X +ExternalAppendOnlyUnsafeRowArray 8 8 0 19.8 50.6 1.4X + + diff --git a/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-results.txt b/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-results.txt index 02c6b72f32..c4be80af13 100644 --- a/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-results.txt +++ b/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-results.txt @@ -2,44 +2,44 @@ WITHOUT SPILL ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Array with 100000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -ArrayBuffer 6378 / 6550 16.1 62.3 1.0X -ExternalAppendOnlyUnsafeRowArray 6196 / 6242 16.5 60.5 1.0X +Array with 100000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ArrayBuffer 7626 7776 212 13.4 74.5 1.0X +ExternalAppendOnlyUnsafeRowArray 8432 8498 93 12.1 82.3 0.9X -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Array with 1000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -ArrayBuffer 11988 / 12027 21.9 45.7 1.0X -ExternalAppendOnlyUnsafeRowArray 37480 / 37574 7.0 143.0 0.3X +Array with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ArrayBuffer 11753 11763 15 22.3 44.8 1.0X +ExternalAppendOnlyUnsafeRowArray 38921 39236 446 6.7 148.5 0.3X -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Array with 30000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -ArrayBuffer 23536 / 23538 20.9 47.9 1.0X -ExternalAppendOnlyUnsafeRowArray 31275 / 31277 15.7 63.6 0.8X +Array with 30000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +ArrayBuffer 23820 23829 12 20.6 48.5 1.0X +ExternalAppendOnlyUnsafeRowArray 33449 33466 25 14.7 68.1 0.7X ================================================================================================ WITH SPILL ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Spilling with 1000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -UnsafeExternalSorter 29241 / 29279 9.0 111.5 1.0X -ExternalAppendOnlyUnsafeRowArray 14309 / 14313 18.3 54.6 2.0X +Spilling with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +UnsafeExternalSorter 31384 31479 135 8.4 119.7 1.0X +ExternalAppendOnlyUnsafeRowArray 15278 15303 35 17.2 58.3 2.1X -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Spilling with 10000 rows: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -UnsafeExternalSorter 11 / 11 14.8 67.4 1.0X -ExternalAppendOnlyUnsafeRowArray 9 / 9 17.6 56.8 1.2X +Spilling with 10000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +UnsafeExternalSorter 11 11 1 14.7 68.0 1.0X +ExternalAppendOnlyUnsafeRowArray 9 10 1 17.1 58.5 1.2X diff --git a/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt b/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt index 9ee9176bea..74f01f6ee4 100644 --- a/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt @@ -2,99 +2,99 @@ OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 438 548 128 22.8 43.8 1.0X -MILLENNIUM of timestamp 1343 1453 139 7.4 134.3 0.3X -CENTURY of timestamp 1287 1305 16 7.8 128.7 0.3X -DECADE of timestamp 1253 1258 7 8.0 125.3 0.3X -YEAR of timestamp 1224 1247 24 8.2 122.4 0.4X -ISOYEAR of timestamp 1356 1383 35 7.4 135.6 0.3X -QUARTER of timestamp 1386 1395 8 7.2 138.6 0.3X -MONTH of timestamp 1215 1227 11 8.2 121.5 0.4X -WEEK of timestamp 1711 1720 9 5.8 171.1 0.3X -DAY of timestamp 1227 1251 37 8.1 122.7 0.4X -DAYOFWEEK of timestamp 1386 1392 11 7.2 138.6 0.3X -DOW of timestamp 1405 1426 34 7.1 140.5 0.3X -ISODOW of timestamp 1344 1363 30 7.4 134.4 0.3X -DOY of timestamp 1249 1251 3 8.0 124.9 0.4X -HOUR of timestamp 766 773 9 13.1 76.6 0.6X -MINUTE of timestamp 761 774 22 13.1 76.1 0.6X -SECOND of timestamp 627 638 11 16.0 62.7 0.7X -MILLISECONDS of timestamp 700 704 4 14.3 70.0 0.6X -MICROSECONDS of timestamp 615 627 10 16.3 61.5 0.7X -EPOCH of timestamp 28897 28929 29 0.3 2889.7 0.0X +cast to timestamp 342 456 120 29.2 34.2 1.0X +MILLENNIUM of timestamp 1462 1498 53 6.8 146.2 0.2X +CENTURY of timestamp 1229 1293 86 8.1 122.9 0.3X +DECADE of timestamp 1204 1242 56 8.3 120.4 0.3X +YEAR of timestamp 1180 1226 72 8.5 118.0 0.3X +ISOYEAR of timestamp 1279 1301 33 7.8 127.9 0.3X +QUARTER of timestamp 1357 1379 22 7.4 135.7 0.3X +MONTH of timestamp 1155 1182 24 8.7 115.5 0.3X +WEEK of timestamp 1634 1641 10 6.1 163.4 0.2X +DAY of timestamp 1167 1171 6 8.6 116.7 0.3X +DAYOFWEEK of timestamp 1335 1344 8 7.5 133.5 0.3X +DOW of timestamp 1344 1352 11 7.4 134.4 0.3X +ISODOW of timestamp 1279 1281 2 7.8 127.9 0.3X +DOY of timestamp 1172 1183 16 8.5 117.2 0.3X +HOUR of timestamp 722 731 12 13.8 72.2 0.5X +MINUTE of timestamp 725 734 9 13.8 72.5 0.5X +SECOND of timestamp 656 661 6 15.3 65.6 0.5X +MILLISECONDS of timestamp 630 637 9 15.9 63.0 0.5X +MICROSECONDS of timestamp 587 592 7 17.0 58.7 0.6X +EPOCH of timestamp 1036 1047 13 9.7 103.6 0.3X OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 1078 1081 4 9.3 107.8 1.0X -MILLENNIUM of date 1232 1244 16 8.1 123.2 0.9X -CENTURY of date 1233 1234 1 8.1 123.3 0.9X -DECADE of date 1210 1212 3 8.3 121.0 0.9X -YEAR of date 1201 1212 9 8.3 120.1 0.9X -ISOYEAR of date 1468 1474 5 6.8 146.8 0.7X -QUARTER of date 1474 1482 11 6.8 147.4 0.7X -MONTH of date 1211 1215 4 8.3 121.1 0.9X -WEEK of date 1684 1685 2 5.9 168.4 0.6X -DAY of date 1208 1214 6 8.3 120.8 0.9X -DAYOFWEEK of date 1374 1387 23 7.3 137.4 0.8X -DOW of date 1396 1404 11 7.2 139.6 0.8X -ISODOW of date 1320 1322 3 7.6 132.0 0.8X -DOY of date 1243 1258 13 8.0 124.3 0.9X -HOUR of date 1997 2018 29 5.0 199.7 0.5X -MINUTE of date 2021 2039 26 4.9 202.1 0.5X -SECOND of date 1862 1878 22 5.4 186.2 0.6X -MILLISECONDS of date 1998 2015 16 5.0 199.8 0.5X -MICROSECONDS of date 1893 1901 7 5.3 189.3 0.6X -EPOCH of date 30353 30376 41 0.3 3035.3 0.0X +cast to date 1044 1081 63 9.6 104.4 1.0X +MILLENNIUM of date 1367 1375 10 7.3 136.7 0.8X +CENTURY of date 1181 1183 3 8.5 118.1 0.9X +DECADE of date 1154 1163 8 8.7 115.4 0.9X +YEAR of date 1138 1154 16 8.8 113.8 0.9X +ISOYEAR of date 1394 1401 8 7.2 139.4 0.7X +QUARTER of date 1336 1362 26 7.5 133.6 0.8X +MONTH of date 1137 1144 11 8.8 113.7 0.9X +WEEK of date 1619 1632 18 6.2 161.9 0.6X +DAY of date 1144 1158 22 8.7 114.4 0.9X +DAYOFWEEK of date 1328 1330 2 7.5 132.8 0.8X +DOW of date 1336 1339 4 7.5 133.6 0.8X +ISODOW of date 1272 1276 3 7.9 127.2 0.8X +DOY of date 1170 1174 4 8.6 117.0 0.9X +HOUR of date 1963 1986 35 5.1 196.3 0.5X +MINUTE of date 1969 1984 19 5.1 196.9 0.5X +SECOND of date 1926 1929 3 5.2 192.6 0.5X +MILLISECONDS of date 1928 1939 16 5.2 192.8 0.5X +MICROSECONDS of date 1816 1821 4 5.5 181.6 0.6X +EPOCH of date 2331 2336 4 4.3 233.1 0.4X OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 384 389 4 26.1 38.4 1.0X -MILLENNIUM of timestamp 1237 1244 6 8.1 123.7 0.3X -CENTURY of timestamp 1236 1244 7 8.1 123.6 0.3X -DECADE of timestamp 1204 1210 9 8.3 120.4 0.3X -YEAR of timestamp 1197 1207 16 8.4 119.7 0.3X -ISOYEAR of timestamp 1466 1470 4 6.8 146.6 0.3X -QUARTER of timestamp 1500 1505 6 6.7 150.0 0.3X -MONTH of timestamp 1190 1218 25 8.4 119.0 0.3X -WEEK of timestamp 1681 1710 25 5.9 168.1 0.2X -DAY of timestamp 1201 1206 7 8.3 120.1 0.3X -DAYOFWEEK of timestamp 1376 1390 13 7.3 137.6 0.3X -DOW of timestamp 1399 1409 17 7.1 139.9 0.3X -ISODOW of timestamp 1347 1354 8 7.4 134.7 0.3X -DOY of timestamp 1257 1263 6 8.0 125.7 0.3X -HOUR of timestamp 749 753 5 13.4 74.9 0.5X -MINUTE of timestamp 746 749 4 13.4 74.6 0.5X -SECOND of timestamp 626 637 15 16.0 62.6 0.6X -MILLISECONDS of timestamp 695 724 25 14.4 69.5 0.6X -MICROSECONDS of timestamp 611 629 27 16.4 61.1 0.6X -EPOCH of timestamp 28908 28938 31 0.3 2890.8 0.0X +cast to timestamp 315 320 8 31.8 31.5 1.0X +MILLENNIUM of timestamp 1365 1369 4 7.3 136.5 0.2X +CENTURY of timestamp 1176 1179 4 8.5 117.6 0.3X +DECADE of timestamp 1153 1168 14 8.7 115.3 0.3X +YEAR of timestamp 1131 1135 5 8.8 113.1 0.3X +ISOYEAR of timestamp 1388 1397 8 7.2 138.8 0.2X +QUARTER of timestamp 1344 1363 25 7.4 134.4 0.2X +MONTH of timestamp 1135 1141 6 8.8 113.5 0.3X +WEEK of timestamp 1612 1615 5 6.2 161.2 0.2X +DAY of timestamp 1138 1145 7 8.8 113.8 0.3X +DAYOFWEEK of timestamp 1322 1330 7 7.6 132.2 0.2X +DOW of timestamp 1317 1323 5 7.6 131.7 0.2X +ISODOW of timestamp 1284 1287 4 7.8 128.4 0.2X +DOY of timestamp 1163 1172 11 8.6 116.3 0.3X +HOUR of timestamp 709 709 1 14.1 70.9 0.4X +MINUTE of timestamp 713 714 1 14.0 71.3 0.4X +SECOND of timestamp 635 641 6 15.7 63.5 0.5X +MILLISECONDS of timestamp 625 629 7 16.0 62.5 0.5X +MICROSECONDS of timestamp 572 573 2 17.5 57.2 0.6X +EPOCH of timestamp 1031 1033 3 9.7 103.1 0.3X OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 1076 1083 6 9.3 107.6 1.0X -MILLENNIUM of date 1230 1236 7 8.1 123.0 0.9X -CENTURY of date 1245 1250 5 8.0 124.5 0.9X -DECADE of date 1206 1211 8 8.3 120.6 0.9X -YEAR of date 1194 1201 6 8.4 119.4 0.9X -ISOYEAR of date 1461 1471 9 6.8 146.1 0.7X -QUARTER of date 1496 1500 7 6.7 149.6 0.7X -MONTH of date 1192 1195 4 8.4 119.2 0.9X -WEEK of date 1682 1687 6 5.9 168.2 0.6X -DAY of date 1199 1207 14 8.3 119.9 0.9X -DAYOFWEEK of date 1372 1383 19 7.3 137.2 0.8X -DOW of date 1384 1393 14 7.2 138.4 0.8X -ISODOW of date 1327 1338 10 7.5 132.7 0.8X -DOY of date 1243 1247 7 8.0 124.3 0.9X -HOUR of date 2001 2010 10 5.0 200.1 0.5X -MINUTE of date 2046 2053 9 4.9 204.6 0.5X -SECOND of date 1859 1863 4 5.4 185.9 0.6X -MILLISECONDS of date 2000 2013 16 5.0 200.0 0.5X -MICROSECONDS of date 1856 1857 1 5.4 185.6 0.6X -EPOCH of date 30365 30388 29 0.3 3036.5 0.0X +cast to date 994 998 3 10.1 99.4 1.0X +MILLENNIUM of date 1361 1371 9 7.3 136.1 0.7X +CENTURY of date 1171 1180 15 8.5 117.1 0.8X +DECADE of date 1149 1153 4 8.7 114.9 0.9X +YEAR of date 1128 1130 2 8.9 112.8 0.9X +ISOYEAR of date 1384 1398 19 7.2 138.4 0.7X +QUARTER of date 1333 1345 19 7.5 133.3 0.7X +MONTH of date 1132 1138 7 8.8 113.2 0.9X +WEEK of date 1616 1624 9 6.2 161.6 0.6X +DAY of date 1132 1135 3 8.8 113.2 0.9X +DAYOFWEEK of date 1320 1322 3 7.6 132.0 0.8X +DOW of date 1317 1319 2 7.6 131.7 0.8X +ISODOW of date 1269 1272 5 7.9 126.9 0.8X +DOY of date 1171 1190 17 8.5 117.1 0.8X +HOUR of date 1960 1962 2 5.1 196.0 0.5X +MINUTE of date 1974 1975 1 5.1 197.4 0.5X +SECOND of date 1915 1922 8 5.2 191.5 0.5X +MILLISECONDS of date 1923 1924 2 5.2 192.3 0.5X +MICROSECONDS of date 1817 1819 1 5.5 181.7 0.5X +EPOCH of date 2323 2326 2 4.3 232.3 0.4X diff --git a/sql/core/benchmarks/ExtractBenchmark-results.txt b/sql/core/benchmarks/ExtractBenchmark-results.txt index e290481b92..07c794fe0c 100644 --- a/sql/core/benchmarks/ExtractBenchmark-results.txt +++ b/sql/core/benchmarks/ExtractBenchmark-results.txt @@ -1,100 +1,100 @@ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 255 307 48 39.2 25.5 1.0X -MILLENNIUM of timestamp 1269 1316 64 7.9 126.9 0.2X -CENTURY of timestamp 1157 1188 33 8.6 115.7 0.2X -DECADE of timestamp 1067 1122 52 9.4 106.7 0.2X -YEAR of timestamp 1099 1163 76 9.1 109.9 0.2X -ISOYEAR of timestamp 1133 1181 43 8.8 113.3 0.2X -QUARTER of timestamp 1192 1222 28 8.4 119.2 0.2X -MONTH of timestamp 1035 1057 38 9.7 103.5 0.2X -WEEK of timestamp 1519 1570 61 6.6 151.9 0.2X -DAY of timestamp 1020 1046 37 9.8 102.0 0.3X -DAYOFWEEK of timestamp 1159 1194 41 8.6 115.9 0.2X -DOW of timestamp 1151 1163 17 8.7 115.1 0.2X -ISODOW of timestamp 1099 1117 26 9.1 109.9 0.2X -DOY of timestamp 1050 1067 27 9.5 105.0 0.2X -HOUR of timestamp 442 449 6 22.6 44.2 0.6X -MINUTE of timestamp 434 437 4 23.1 43.4 0.6X -SECOND of timestamp 606 612 5 16.5 60.6 0.4X -MILLISECONDS of timestamp 627 629 3 15.9 62.7 0.4X -MICROSECONDS of timestamp 528 530 2 18.9 52.8 0.5X -EPOCH of timestamp 998 1001 3 10.0 99.8 0.3X +cast to timestamp 404 460 71 24.8 40.4 1.0X +MILLENNIUM of timestamp 1432 1580 128 7.0 143.2 0.3X +CENTURY of timestamp 1380 1390 10 7.2 138.0 0.3X +DECADE of timestamp 1254 1261 8 8.0 125.4 0.3X +YEAR of timestamp 1229 1236 9 8.1 122.9 0.3X +ISOYEAR of timestamp 1382 1415 44 7.2 138.2 0.3X +QUARTER of timestamp 1444 1458 16 6.9 144.4 0.3X +MONTH of timestamp 1212 1257 60 8.2 121.2 0.3X +WEEK of timestamp 1718 1730 12 5.8 171.8 0.2X +DAY of timestamp 1180 1201 22 8.5 118.0 0.3X +DAYOFWEEK of timestamp 1371 1427 68 7.3 137.1 0.3X +DOW of timestamp 1365 1378 18 7.3 136.5 0.3X +ISODOW of timestamp 1312 1319 7 7.6 131.2 0.3X +DOY of timestamp 1224 1238 16 8.2 122.4 0.3X +HOUR of timestamp 343 355 16 29.2 34.3 1.2X +MINUTE of timestamp 341 344 3 29.3 34.1 1.2X +SECOND of timestamp 553 556 2 18.1 55.3 0.7X +MILLISECONDS of timestamp 562 565 3 17.8 56.2 0.7X +MICROSECONDS of timestamp 435 465 49 23.0 43.5 0.9X +EPOCH of timestamp 1211 1217 9 8.3 121.1 0.3X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 859 862 3 11.6 85.9 1.0X -MILLENNIUM of date 1097 1097 1 9.1 109.7 0.8X -CENTURY of date 1100 1105 6 9.1 110.0 0.8X -DECADE of date 1030 1032 1 9.7 103.0 0.8X -YEAR of date 1011 1014 3 9.9 101.1 0.8X -ISOYEAR of date 1228 1242 20 8.1 122.8 0.7X -QUARTER of date 1241 1259 17 8.1 124.1 0.7X -MONTH of date 1016 1018 2 9.8 101.6 0.8X -WEEK of date 1485 1496 9 6.7 148.5 0.6X -DAY of date 1019 1027 11 9.8 101.9 0.8X -DAYOFWEEK of date 1131 1142 10 8.8 113.1 0.8X -DOW of date 1125 1132 7 8.9 112.5 0.8X -ISODOW of date 1087 1089 2 9.2 108.7 0.8X -DOY of date 1053 1057 3 9.5 105.3 0.8X -HOUR of date 1768 1773 5 5.7 176.8 0.5X -MINUTE of date 1764 1771 9 5.7 176.4 0.5X -SECOND of date 1960 1964 4 5.1 196.0 0.4X -MILLISECONDS of date 1967 1971 4 5.1 196.7 0.4X -MICROSECONDS of date 1852 1859 6 5.4 185.2 0.5X -EPOCH of date 2387 2390 4 4.2 238.7 0.4X +cast to date 1030 1038 8 9.7 103.0 1.0X +MILLENNIUM of date 1302 1306 6 7.7 130.2 0.8X +CENTURY of date 1309 1315 6 7.6 130.9 0.8X +DECADE of date 1197 1202 7 8.4 119.7 0.9X +YEAR of date 1182 1192 10 8.5 118.2 0.9X +ISOYEAR of date 1421 1429 10 7.0 142.1 0.7X +QUARTER of date 1454 1468 14 6.9 145.4 0.7X +MONTH of date 1217 1230 19 8.2 121.7 0.8X +WEEK of date 1723 1725 3 5.8 172.3 0.6X +DAY of date 1188 1191 4 8.4 118.8 0.9X +DAYOFWEEK of date 1348 1355 6 7.4 134.8 0.8X +DOW of date 1344 1353 8 7.4 134.4 0.8X +ISODOW of date 1301 1311 9 7.7 130.1 0.8X +DOY of date 1237 1241 4 8.1 123.7 0.8X +HOUR of date 1465 1474 16 6.8 146.5 0.7X +MINUTE of date 1463 1471 8 6.8 146.3 0.7X +SECOND of date 1720 1725 5 5.8 172.0 0.6X +MILLISECONDS of date 1739 1749 9 5.8 173.9 0.6X +MICROSECONDS of date 1607 1611 4 6.2 160.7 0.6X +EPOCH of date 2370 2377 10 4.2 237.0 0.4X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 242 248 10 41.3 24.2 1.0X -MILLENNIUM of timestamp 1121 1128 9 8.9 112.1 0.2X -CENTURY of timestamp 1104 1109 7 9.1 110.4 0.2X -DECADE of timestamp 1023 1026 3 9.8 102.3 0.2X -YEAR of timestamp 1009 1011 2 9.9 100.9 0.2X -ISOYEAR of timestamp 1225 1228 4 8.2 122.5 0.2X -QUARTER of timestamp 1222 1226 3 8.2 122.2 0.2X -MONTH of timestamp 1017 1018 1 9.8 101.7 0.2X -WEEK of timestamp 1480 1485 5 6.8 148.0 0.2X -DAY of timestamp 1010 1012 2 9.9 101.0 0.2X -DAYOFWEEK of timestamp 1124 1128 3 8.9 112.4 0.2X -DOW of timestamp 1119 1121 3 8.9 111.9 0.2X -ISODOW of timestamp 1085 1087 4 9.2 108.5 0.2X -DOY of timestamp 1040 1054 12 9.6 104.0 0.2X -HOUR of timestamp 433 435 2 23.1 43.3 0.6X -MINUTE of timestamp 430 431 2 23.3 43.0 0.6X -SECOND of timestamp 600 603 3 16.7 60.0 0.4X -MILLISECONDS of timestamp 618 623 5 16.2 61.8 0.4X -MICROSECONDS of timestamp 521 524 3 19.2 52.1 0.5X -EPOCH of timestamp 987 989 2 10.1 98.7 0.2X +cast to timestamp 307 312 6 32.6 30.7 1.0X +MILLENNIUM of timestamp 1294 1298 4 7.7 129.4 0.2X +CENTURY of timestamp 1317 1321 6 7.6 131.7 0.2X +DECADE of timestamp 1202 1207 8 8.3 120.2 0.3X +YEAR of timestamp 1196 1201 8 8.4 119.6 0.3X +ISOYEAR of timestamp 1431 1440 10 7.0 143.1 0.2X +QUARTER of timestamp 1483 1487 5 6.7 148.3 0.2X +MONTH of timestamp 1205 1209 4 8.3 120.5 0.3X +WEEK of timestamp 1728 1731 4 5.8 172.8 0.2X +DAY of timestamp 1190 1193 3 8.4 119.0 0.3X +DAYOFWEEK of timestamp 1369 1371 2 7.3 136.9 0.2X +DOW of timestamp 1371 1373 3 7.3 137.1 0.2X +ISODOW of timestamp 1316 1321 8 7.6 131.6 0.2X +DOY of timestamp 1236 1241 6 8.1 123.6 0.2X +HOUR of timestamp 342 343 1 29.3 34.2 0.9X +MINUTE of timestamp 338 352 23 29.6 33.8 0.9X +SECOND of timestamp 555 556 1 18.0 55.5 0.6X +MILLISECONDS of timestamp 570 573 4 17.6 57.0 0.5X +MICROSECONDS of timestamp 436 442 5 22.9 43.6 0.7X +EPOCH of timestamp 1212 1218 7 8.3 121.2 0.3X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 856 865 8 11.7 85.6 1.0X -MILLENNIUM of date 1096 1098 3 9.1 109.6 0.8X -CENTURY of date 1095 1099 4 9.1 109.5 0.8X -DECADE of date 1023 1028 6 9.8 102.3 0.8X -YEAR of date 1006 1011 5 9.9 100.6 0.9X -ISOYEAR of date 1201 1212 14 8.3 120.1 0.7X -QUARTER of date 1224 1228 4 8.2 122.4 0.7X -MONTH of date 1009 1011 2 9.9 100.9 0.8X -WEEK of date 1478 1485 7 6.8 147.8 0.6X -DAY of date 1006 1008 3 9.9 100.6 0.9X -DAYOFWEEK of date 1131 1133 2 8.8 113.1 0.8X -DOW of date 1119 1121 2 8.9 111.9 0.8X -ISODOW of date 1083 1085 3 9.2 108.3 0.8X -DOY of date 1035 1051 25 9.7 103.5 0.8X -HOUR of date 1764 1779 22 5.7 176.4 0.5X -MINUTE of date 1763 1766 2 5.7 176.3 0.5X -SECOND of date 1957 1965 10 5.1 195.7 0.4X -MILLISECONDS of date 1960 1961 2 5.1 196.0 0.4X -MICROSECONDS of date 1852 1854 2 5.4 185.2 0.5X -EPOCH of date 2381 2383 3 4.2 238.1 0.4X +cast to date 1017 1025 13 9.8 101.7 1.0X +MILLENNIUM of date 1314 1318 5 7.6 131.4 0.8X +CENTURY of date 1318 1334 16 7.6 131.8 0.8X +DECADE of date 1205 1210 5 8.3 120.5 0.8X +YEAR of date 1187 1190 3 8.4 118.7 0.9X +ISOYEAR of date 1409 1432 21 7.1 140.9 0.7X +QUARTER of date 1477 1482 6 6.8 147.7 0.7X +MONTH of date 1193 1199 7 8.4 119.3 0.9X +WEEK of date 1711 1719 7 5.8 171.1 0.6X +DAY of date 1183 1192 7 8.5 118.3 0.9X +DAYOFWEEK of date 1368 1371 6 7.3 136.8 0.7X +DOW of date 1361 1366 8 7.3 136.1 0.7X +ISODOW of date 1312 1315 3 7.6 131.2 0.8X +DOY of date 1230 1233 2 8.1 123.0 0.8X +HOUR of date 1480 1483 2 6.8 148.0 0.7X +MINUTE of date 1473 1489 27 6.8 147.3 0.7X +SECOND of date 1731 1737 7 5.8 173.1 0.6X +MILLISECONDS of date 1744 1749 6 5.7 174.4 0.6X +MICROSECONDS of date 1592 1594 1 6.3 159.2 0.6X +EPOCH of date 2368 2371 3 4.2 236.8 0.4X diff --git a/sql/core/benchmarks/HashedRelationMetricsBenchmark-jdk11-results.txt b/sql/core/benchmarks/HashedRelationMetricsBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..e01561364b --- /dev/null +++ b/sql/core/benchmarks/HashedRelationMetricsBenchmark-jdk11-results.txt @@ -0,0 +1,11 @@ +================================================================================================ +LongToUnsafeRowMap metrics +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +LongToUnsafeRowMap metrics: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +LongToUnsafeRowMap 568 575 5 0.9 1136.4 1.0X + + diff --git a/sql/core/benchmarks/HashedRelationMetricsBenchmark-results.txt b/sql/core/benchmarks/HashedRelationMetricsBenchmark-results.txt index 338244ad54..7483f517a6 100644 --- a/sql/core/benchmarks/HashedRelationMetricsBenchmark-results.txt +++ b/sql/core/benchmarks/HashedRelationMetricsBenchmark-results.txt @@ -2,10 +2,10 @@ LongToUnsafeRowMap metrics ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_181-b13 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-7700HQ CPU @ 2.80GHz -LongToUnsafeRowMap metrics: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -LongToUnsafeRowMap 234 / 315 2.1 467.3 1.0X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +LongToUnsafeRowMap metrics: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +LongToUnsafeRowMap 513 629 106 1.0 1026.6 1.0X diff --git a/sql/core/benchmarks/JSONBenchmark-jdk11-results.txt b/sql/core/benchmarks/JSONBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..56a87d41e3 --- /dev/null +++ b/sql/core/benchmarks/JSONBenchmark-jdk11-results.txt @@ -0,0 +1,112 @@ +================================================================================================ +Benchmark for performance of JSON parsing +================================================================================================ + +Preparing data for benchmarking ... +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +No encoding 70863 71147 417 1.4 708.6 1.0X +UTF-8 is set 133520 133658 131 0.7 1335.2 0.5X + +Preparing data for benchmarking ... +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +No encoding 44462 44655 313 2.2 444.6 1.0X +UTF-8 is set 89342 89386 53 1.1 893.4 0.5X + +Preparing data for benchmarking ... +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +No encoding 58617 59071 541 0.2 5861.7 1.0X +UTF-8 is set 102650 102948 493 0.1 10265.0 0.6X + +Preparing data for benchmarking ... +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +No encoding 168197 168256 61 0.0 336393.0 1.0X +UTF-8 is set 191539 191724 186 0.0 383078.2 0.9X + +Preparing data for benchmarking ... +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Select 10 columns 18983 18998 22 0.5 1898.3 1.0X +Select 1 column 23544 23575 32 0.4 2354.4 0.8X + +Preparing data for benchmarking ... +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Short column without encoding 9336 9402 66 1.1 933.6 1.0X +Short column with UTF-8 13310 13870 489 0.8 1331.0 0.7X +Wide column without encoding 112821 113012 202 0.1 11282.1 0.1X +Wide column with UTF-8 156408 156910 776 0.1 15640.8 0.1X + +Preparing data for benchmarking ... +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Text read 743 744 1 13.5 74.3 1.0X +from_json 22379 22566 279 0.4 2237.9 0.0X +json_tuple 32201 32271 89 0.3 3220.1 0.0X +get_json_object 21973 22405 375 0.5 2197.3 0.0X + +Preparing data for benchmarking ... +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Text read 3771 3780 8 13.3 75.4 1.0X +schema inferring 34808 35213 506 1.4 696.2 0.1X +parsing 36917 38889 1757 1.4 738.3 0.1X + +Preparing data for benchmarking ... +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Text read 11928 11955 38 4.2 238.6 1.0X +Schema inferring 44716 44921 220 1.1 894.3 0.3X +Parsing without charset 35749 35838 77 1.4 715.0 0.3X +Parsing with UTF-8 50521 50530 12 1.0 1010.4 0.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Create a dataset of timestamps 2473 2487 18 4.0 247.3 1.0X +to_json(timestamp) 16100 16284 236 0.6 1610.0 0.2X +write timestamps to files 13226 13852 676 0.8 1322.6 0.2X +Create a dataset of dates 2661 2680 16 3.8 266.1 0.9X +to_json(date) 10696 10730 55 0.9 1069.6 0.2X +write dates to files 8543 8926 384 1.2 854.3 0.3X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +read timestamp text from files 2822 2829 8 3.5 282.2 1.0X +read timestamps from files 34884 34900 23 0.3 3488.4 0.1X +infer timestamps from files 70310 71551 1079 0.1 7031.0 0.0X +read date text from files 2649 2655 6 3.8 264.9 1.1X +read date from files 22875 22904 33 0.4 2287.5 0.1X +timestamp strings 4025 4059 31 2.5 402.5 0.7X +parse timestamps from Dataset[String] 43040 43157 115 0.2 4304.0 0.1X +infer timestamps from Dataset[String] 81762 81927 144 0.1 8176.2 0.0X +date strings 4899 4913 21 2.0 489.9 0.6X +parse dates from Dataset[String] 33530 33560 27 0.3 3353.0 0.1X +from_json(timestamp) 60762 60877 142 0.2 6076.2 0.0X +from_json(date) 52482 52620 150 0.2 5248.2 0.1X + + diff --git a/sql/core/benchmarks/JSONBenchmark-results.txt b/sql/core/benchmarks/JSONBenchmark-results.txt index 7846983b44..56d371eade 100644 --- a/sql/core/benchmarks/JSONBenchmark-results.txt +++ b/sql/core/benchmarks/JSONBenchmark-results.txt @@ -3,110 +3,110 @@ Benchmark for performance of JSON parsing ================================================================================================ Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 50949 51086 150 2.0 509.5 1.0X -UTF-8 is set 72012 72147 120 1.4 720.1 0.7X +No encoding 69387 69850 407 1.4 693.9 1.0X +UTF-8 is set 112131 112205 83 0.9 1121.3 0.6X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 36799 36891 80 2.7 368.0 1.0X -UTF-8 is set 59796 59880 74 1.7 598.0 0.6X +No encoding 44542 44671 122 2.2 445.4 1.0X +UTF-8 is set 71793 71945 146 1.4 717.9 0.6X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 55803 55967 152 0.2 5580.3 1.0X -UTF-8 is set 80623 80825 178 0.1 8062.3 0.7X +No encoding 58615 59011 347 0.2 5861.5 1.0X +UTF-8 is set 102542 102719 153 0.1 10254.2 0.6X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 84263 85750 1476 0.0 168526.2 1.0X -UTF-8 is set 98848 100183 1592 0.0 197696.0 0.9X +No encoding 168861 170014 1552 0.0 337722.0 1.0X +UTF-8 is set 191140 191250 112 0.0 382280.3 0.9X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns 13930 13996 60 0.7 1393.0 1.0X -Select 1 column 17092 17394 360 0.6 1709.2 0.8X +Select 10 columns 28017 28066 47 0.4 2801.7 1.0X +Select 1 column 24590 24641 67 0.4 2459.0 1.1X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Short column without encoding 5596 5711 101 1.8 559.6 1.0X -Short column with UTF-8 7983 8158 160 1.3 798.3 0.7X -Wide column without encoding 110189 118451 NaN 0.1 11018.9 0.1X -Wide column with UTF-8 137827 142813 NaN 0.1 13782.7 0.0X +Short column without encoding 17179 17465 487 0.6 1717.9 1.0X +Short column with UTF-8 25173 25255 139 0.4 2517.3 0.7X +Wide column without encoding 146956 147069 104 0.1 14695.6 0.1X +Wide column with UTF-8 196626 197233 549 0.1 19662.6 0.1X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 951 953 2 10.5 95.1 1.0X -from_json 13015 13045 27 0.8 1301.5 0.1X -json_tuple 16257 16306 43 0.6 1625.7 0.1X -get_json_object 13195 13225 39 0.8 1319.5 0.1X +Text read 1206 1212 5 8.3 120.6 1.0X +from_json 27641 27680 34 0.4 2764.1 0.0X +json_tuple 43404 44377 860 0.2 4340.4 0.0X +get_json_object 26821 27239 619 0.4 2682.1 0.0X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 4632 4687 49 10.8 92.6 1.0X -schema inferring 29176 29297 146 1.7 583.5 0.2X -parsing 24268 24457 175 2.1 485.4 0.2X +Text read 5842 5865 33 8.6 116.8 1.0X +schema inferring 69673 70082 478 0.7 1393.5 0.1X +parsing 78805 81812 NaN 0.6 1576.1 0.1X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 8264 8272 7 6.1 165.3 1.0X -Schema inferring 31910 32375 543 1.6 638.2 0.3X -Parsing without charset 29290 29397 124 1.7 585.8 0.3X -Parsing with UTF-8 41301 41390 81 1.2 826.0 0.2X +Text read 10782 10801 18 4.6 215.6 1.0X +Schema inferring 76817 77205 623 0.7 1536.3 0.1X +Parsing without charset 90638 91395 794 0.6 1812.8 0.1X +Parsing with UTF-8 120085 121975 1705 0.4 2401.7 0.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 1149 1160 11 8.7 114.9 1.0X -to_json(timestamp) 11585 11688 140 0.9 1158.5 0.1X -write timestamps to files 10212 10260 49 1.0 1021.2 0.1X -Create a dataset of dates 1322 1328 10 7.6 132.2 0.9X -to_json(date) 7226 7241 14 1.4 722.6 0.2X -write dates to files 5634 5648 20 1.8 563.4 0.2X +Create a dataset of timestamps 4706 4717 9 2.1 470.6 1.0X +to_json(timestamp) 29447 29615 226 0.3 2944.7 0.2X +write timestamps to files 20251 20673 503 0.5 2025.1 0.2X +Create a dataset of dates 4157 4172 18 2.4 415.7 1.1X +to_json(date) 21267 21301 53 0.5 2126.7 0.2X +write dates to files 13477 13897 485 0.7 1347.7 0.3X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.4 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 2097 2137 41 4.8 209.7 1.0X -read timestamps from files 20438 20451 11 0.5 2043.8 0.1X -infer timestamps from files 41694 41770 66 0.2 4169.4 0.1X -read date text from files 1832 1847 16 5.5 183.2 1.1X -read date from files 13796 13837 49 0.7 1379.6 0.2X -timestamp strings 3213 3233 26 3.1 321.3 0.7X -parse timestamps from Dataset[String] 22686 22743 53 0.4 2268.6 0.1X -infer timestamps from Dataset[String] 45301 45368 58 0.2 4530.1 0.0X -date strings 3431 3439 7 2.9 343.1 0.6X -parse dates from Dataset[String] 17688 17734 41 0.6 1768.8 0.1X -from_json(timestamp) 33439 33456 24 0.3 3343.9 0.1X -from_json(date) 24055 24164 107 0.4 2405.5 0.1X +read timestamp text from files 2666 2687 29 3.8 266.6 1.0X +read timestamps from files 46967 47354 438 0.2 4696.7 0.1X +infer timestamps from files 97693 97745 65 0.1 9769.3 0.0X +read date text from files 2594 2599 5 3.9 259.4 1.0X +read date from files 35796 36008 195 0.3 3579.6 0.1X +timestamp strings 6367 6424 84 1.6 636.7 0.4X +parse timestamps from Dataset[String] 58863 59255 340 0.2 5886.3 0.0X +infer timestamps from Dataset[String] 114148 114820 836 0.1 11414.8 0.0X +date strings 7847 7863 22 1.3 784.7 0.3X +parse dates from Dataset[String] 49085 49289 212 0.2 4908.5 0.1X +from_json(timestamp) 77030 77335 395 0.1 7703.0 0.0X +from_json(date) 63275 63290 15 0.2 6327.5 0.0X diff --git a/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt b/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..06b220586e --- /dev/null +++ b/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt @@ -0,0 +1,75 @@ +================================================================================================ +Join Benchmark +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w long wholestage off 4872 4888 24 4.3 232.3 1.0X +Join w long wholestage on 337 425 61 62.3 16.1 14.5X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Join w long duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w long duplicated wholestage off 6290 6346 79 3.3 299.9 1.0X +Join w long duplicated wholestage on 328 347 17 64.0 15.6 19.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Join w 2 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w 2 ints wholestage off 174475 174532 82 0.1 8319.6 1.0X +Join w 2 ints wholestage on 165490 167355 1507 0.1 7891.2 1.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Join w 2 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w 2 longs wholestage off 7025 7121 135 3.0 335.0 1.0X +Join w 2 longs wholestage on 1878 1954 103 11.2 89.5 3.7X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Join w 2 longs duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w 2 longs duplicated wholestage off 20822 20879 81 1.0 992.9 1.0X +Join w 2 longs duplicated wholestage on 2454 2512 60 8.5 117.0 8.5X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +outer join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +outer join w long wholestage off 3900 3907 10 5.4 186.0 1.0X +outer join w long wholestage on 226 235 10 92.6 10.8 17.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +semi join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +semi join w long wholestage off 2560 2621 87 8.2 122.1 1.0X +semi join w long wholestage on 209 219 15 100.5 10.0 12.3X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +sort merge join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +sort merge join wholestage off 1707 1712 7 1.2 814.0 1.0X +sort merge join wholestage on 1447 1482 43 1.4 690.0 1.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +sort merge join with duplicates wholestage off 2293 2307 19 0.9 1093.4 1.0X +sort merge join with duplicates wholestage on 2018 2061 66 1.0 962.1 1.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +shuffle hash join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +shuffle hash join wholestage off 1424 1458 47 2.9 339.6 1.0X +shuffle hash join wholestage on 1203 1227 28 3.5 286.9 1.2X + + diff --git a/sql/core/benchmarks/JoinBenchmark-results.txt b/sql/core/benchmarks/JoinBenchmark-results.txt index 8ceb5e7a7f..3b88d5eacc 100644 --- a/sql/core/benchmarks/JoinBenchmark-results.txt +++ b/sql/core/benchmarks/JoinBenchmark-results.txt @@ -2,74 +2,74 @@ Join Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Join w long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Join w long wholestage off 4464 / 4483 4.7 212.9 1.0X -Join w long wholestage on 289 / 339 72.6 13.8 15.5X +Join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w long wholestage off 4685 4814 182 4.5 223.4 1.0X +Join w long wholestage on 440 524 102 47.7 21.0 10.7X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Join w long duplicated: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Join w long duplicated wholestage off 5662 / 5678 3.7 270.0 1.0X -Join w long duplicated wholestage on 332 / 345 63.1 15.8 17.0X +Join w long duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w long duplicated wholestage off 6266 6291 35 3.3 298.8 1.0X +Join w long duplicated wholestage on 340 359 27 61.7 16.2 18.4X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Join w 2 ints: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Join w 2 ints wholestage off 173174 / 173183 0.1 8257.6 1.0X -Join w 2 ints wholestage on 166350 / 198362 0.1 7932.2 1.0X +Join w 2 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w 2 ints wholestage off 174733 174916 259 0.1 8331.9 1.0X +Join w 2 ints wholestage on 166815 167619 823 0.1 7954.4 1.0X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Join w 2 longs: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Join w 2 longs wholestage off 7055 / 7214 3.0 336.4 1.0X -Join w 2 longs wholestage on 1869 / 1985 11.2 89.1 3.8X +Join w 2 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w 2 longs wholestage off 7835 7889 76 2.7 373.6 1.0X +Join w 2 longs wholestage on 2057 2148 73 10.2 98.1 3.8X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Join w 2 longs duplicated: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Join w 2 longs duplicated wholestage off 19256 / 20283 1.1 918.2 1.0X -Join w 2 longs duplicated wholestage on 2467 / 2544 8.5 117.7 7.8X +Join w 2 longs duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Join w 2 longs duplicated wholestage off 19435 19497 87 1.1 926.7 1.0X +Join w 2 longs duplicated wholestage on 2472 2528 57 8.5 117.9 7.9X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -outer join w long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -outer join w long wholestage off 3756 / 3761 5.6 179.1 1.0X -outer join w long wholestage on 218 / 250 96.2 10.4 17.2X +outer join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +outer join w long wholestage off 3945 3992 66 5.3 188.1 1.0X +outer join w long wholestage on 227 235 11 92.5 10.8 17.4X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -semi join w long: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -semi join w long wholestage off 2393 / 2416 8.8 114.1 1.0X -semi join w long wholestage on 214 / 218 97.9 10.2 11.2X +semi join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +semi join w long wholestage off 2436 2469 46 8.6 116.2 1.0X +semi join w long wholestage on 231 242 11 91.0 11.0 10.6X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -sort merge join: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -sort merge join wholestage off 2318 / 2392 0.9 1105.3 1.0X -sort merge join wholestage on 1669 / 1811 1.3 795.9 1.4X +sort merge join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +sort merge join wholestage off 1820 1825 7 1.2 867.9 1.0X +sort merge join wholestage on 1507 1552 34 1.4 718.8 1.2X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -sort merge join with duplicates: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -sort merge join with duplicates wholestage off 2966 / 2976 0.7 1414.5 1.0X -sort merge join with duplicates wholestage on 2413 / 2641 0.9 1150.5 1.2X +sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +sort merge join with duplicates wholestage off 2319 2380 86 0.9 1105.7 1.0X +sort merge join with duplicates wholestage on 2087 2139 51 1.0 995.3 1.1X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -shuffle hash join: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -shuffle hash join wholestage off 1475 / 1479 2.8 351.7 1.0X -shuffle hash join wholestage on 1209 / 1238 3.5 288.3 1.2X +shuffle hash join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +shuffle hash join wholestage off 1554 1591 52 2.7 370.6 1.0X +shuffle hash join wholestage on 1142 1200 51 3.7 272.2 1.4X diff --git a/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt b/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..f7332d4cea --- /dev/null +++ b/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt @@ -0,0 +1,22 @@ +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +prepare make_date() 2952 3104 224 33.9 29.5 1.0X +make_date(2019, 9, 16) 2341 2585 359 42.7 23.4 1.3X +make_date(*, *, *) 4751 4808 53 21.0 47.5 0.6X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +make_timestamp(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +prepare make_timestamp() 3462 3585 143 0.3 3461.8 1.0X +make_timestamp(2019, 1, 2, 3, 4, 50.123456) 114 120 6 8.7 114.4 30.3X +make_timestamp(2019, 1, 2, 3, 4, 60.000000) 74 82 13 13.5 74.0 46.8X +make_timestamp(2019, 12, 31, 23, 59, 60.00) 82 95 11 12.1 82.5 42.0X +make_timestamp(*, *, *, 3, 4, 50.123456) 293 308 14 3.4 292.9 11.8X +make_timestamp(*, *, *, *, *, 0) 278 284 9 3.6 278.1 12.4X +make_timestamp(*, *, *, *, *, 60.0) 287 289 2 3.5 287.3 12.0X +make_timestamp(2019, 1, 2, *, *, *) 3556 3574 21 0.3 3555.7 1.0X +make_timestamp(*, *, *, *, *, *) 3578 3590 16 0.3 3577.9 1.0X + diff --git a/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt b/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt index a3c89d643e..2b184fd26e 100644 --- a/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt +++ b/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt @@ -1,22 +1,22 @@ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare make_date() 2149 2289 196 46.5 21.5 1.0X -make_date(2019, 9, 16) 1829 1868 58 54.7 18.3 1.2X -make_date(*, *, *) 3180 3339 139 31.4 31.8 0.7X +prepare make_date() 2990 3159 267 33.4 29.9 1.0X +make_date(2019, 9, 16) 2376 2446 90 42.1 23.8 1.3X +make_date(*, *, *) 4751 4786 31 21.0 47.5 0.6X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-4850HQ CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz make_timestamp(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare make_timestamp() 2950 3025 96 0.3 2950.3 1.0X -make_timestamp(2019, 1, 2, 3, 4, 50.123456) 45 47 1 22.1 45.2 65.3X -make_timestamp(2019, 1, 2, 3, 4, 60.000000) 42 42 1 24.0 41.7 70.8X -make_timestamp(2019, 12, 31, 23, 59, 60.00) 41 42 1 24.2 41.3 71.4X -make_timestamp(*, *, *, 3, 4, 50.123456) 252 256 7 4.0 251.5 11.7X -make_timestamp(*, *, *, *, *, 0) 225 227 3 4.5 224.6 13.1X -make_timestamp(*, *, *, *, *, 60.0) 230 233 2 4.3 230.4 12.8X -make_timestamp(2019, 1, 2, *, *, *) 3078 3118 35 0.3 3078.5 1.0X -make_timestamp(*, *, *, *, *, *) 3092 3109 17 0.3 3092.4 1.0X +prepare make_timestamp() 3855 3936 104 0.3 3855.3 1.0X +make_timestamp(2019, 1, 2, 3, 4, 50.123456) 83 87 5 12.0 83.1 46.4X +make_timestamp(2019, 1, 2, 3, 4, 60.000000) 73 82 9 13.8 72.7 53.0X +make_timestamp(2019, 12, 31, 23, 59, 60.00) 66 74 9 15.2 65.8 58.6X +make_timestamp(*, *, *, 3, 4, 50.123456) 266 277 11 3.8 265.9 14.5X +make_timestamp(*, *, *, *, *, 0) 268 275 13 3.7 267.6 14.4X +make_timestamp(*, *, *, *, *, 60.0) 272 273 0 3.7 272.4 14.2X +make_timestamp(2019, 1, 2, *, *, *) 3940 3966 24 0.3 3940.4 1.0X +make_timestamp(*, *, *, *, *, *) 3867 3917 68 0.3 3867.4 1.0X diff --git a/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt b/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..991a447fe3 --- /dev/null +++ b/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt @@ -0,0 +1,127 @@ +================================================================================================ +filter & aggregate without group +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +range/filter/sum wholestage off 52841 53513 951 39.7 25.2 1.0X +range/filter/sum wholestage on 3104 3188 109 675.6 1.5 17.0X + + +================================================================================================ +range/limit/sum +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +range/limit/sum wholestage off 199 222 32 2633.5 0.4 1.0X +range/limit/sum wholestage on 131 138 7 3991.0 0.3 1.5X + + +================================================================================================ +sample +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +sample with replacement wholestage off 13015 13441 602 10.1 99.3 1.0X +sample with replacement wholestage on 7688 7745 91 17.0 58.7 1.7X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +sample without replacement wholestage off 2990 2993 4 43.8 22.8 1.0X +sample without replacement wholestage on 1172 1186 13 111.9 8.9 2.6X + + +================================================================================================ +collect +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +collect 1 million 317 425 188 3.3 301.9 1.0X +collect 2 millions 575 598 26 1.8 548.2 0.6X +collect 4 millions 1350 1848 704 0.8 1287.6 0.2X + + +================================================================================================ +collect limit +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +collect limit 1 million 375 387 14 2.8 358.0 1.0X +collect limit 2 millions 714 736 28 1.5 681.3 0.5X + + +================================================================================================ +generate explode +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate explode array wholestage off 19669 19829 227 0.9 1172.3 1.0X +generate explode array wholestage on 10983 11020 35 1.5 654.7 1.8X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate explode map wholestage off 57756 57928 243 0.3 3442.5 1.0X +generate explode map wholestage on 47398 47703 250 0.4 2825.2 1.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate posexplode array wholestage off 21402 21525 174 0.8 1275.7 1.0X +generate posexplode array wholestage on 11898 11982 67 1.4 709.2 1.8X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate inline array wholestage off 15570 15597 37 1.1 928.1 1.0X +generate inline array wholestage on 10044 10161 87 1.7 598.6 1.6X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate big struct array wholestage off 601 615 19 0.1 10023.5 1.0X +generate big struct array wholestage on 388 410 25 0.2 6458.7 1.6X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate big nested struct array wholestage off 492 525 48 0.1 8191.7 1.0X +generate big nested struct array wholestage on 468 496 30 0.1 7796.4 1.1X + + +================================================================================================ +generate regular generator +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate stack wholestage off 28014 28091 109 0.6 1669.8 1.0X +generate stack wholestage on 19246 19267 27 0.9 1147.2 1.5X + + diff --git a/sql/core/benchmarks/MiscBenchmark-results.txt b/sql/core/benchmarks/MiscBenchmark-results.txt index c4ae052095..012e81b03c 100644 --- a/sql/core/benchmarks/MiscBenchmark-results.txt +++ b/sql/core/benchmarks/MiscBenchmark-results.txt @@ -2,126 +2,126 @@ filter & aggregate without group ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -range/filter/sum: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -range/filter/sum wholestage off 47752 / 48952 43.9 22.8 1.0X -range/filter/sum wholestage on 3123 / 3558 671.5 1.5 15.3X +range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +range/filter/sum wholestage off 45894 47528 2310 45.7 21.9 1.0X +range/filter/sum wholestage on 3193 3572 213 656.8 1.5 14.4X ================================================================================================ range/limit/sum ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -range/limit/sum: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -range/limit/sum wholestage off 229 / 236 2288.9 0.4 1.0X -range/limit/sum wholestage on 257 / 267 2041.0 0.5 0.9X +range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +range/limit/sum wholestage off 202 207 7 2593.1 0.4 1.0X +range/limit/sum wholestage on 148 161 20 3545.1 0.3 1.4X ================================================================================================ sample ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -sample with replacement: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -sample with replacement wholestage off 12908 / 13076 10.2 98.5 1.0X -sample with replacement wholestage on 7334 / 7346 17.9 56.0 1.8X +sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +sample with replacement wholestage off 12337 12657 452 10.6 94.1 1.0X +sample with replacement wholestage on 7355 7368 14 17.8 56.1 1.7X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -sample without replacement: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -sample without replacement wholestage off 3082 / 3095 42.5 23.5 1.0X -sample without replacement wholestage on 1125 / 1211 116.5 8.6 2.7X +sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +sample without replacement wholestage off 3050 3060 14 43.0 23.3 1.0X +sample without replacement wholestage on 1103 1118 22 118.8 8.4 2.8X ================================================================================================ collect ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -collect: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -collect 1 million 291 / 311 3.6 277.3 1.0X -collect 2 millions 552 / 564 1.9 526.6 0.5X -collect 4 millions 1104 / 1108 0.9 1053.0 0.3X +collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +collect 1 million 324 361 41 3.2 309.4 1.0X +collect 2 millions 619 700 70 1.7 590.4 0.5X +collect 4 millions 1214 1293 111 0.9 1158.2 0.3X ================================================================================================ collect limit ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -collect limit: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -collect limit 1 million 311 / 340 3.4 296.2 1.0X -collect limit 2 millions 581 / 614 1.8 554.4 0.5X +collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +collect limit 1 million 391 396 5 2.7 373.0 1.0X +collect limit 2 millions 746 769 26 1.4 711.8 0.5X ================================================================================================ generate explode ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -generate explode array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -generate explode array wholestage off 15211 / 15368 1.1 906.6 1.0X -generate explode array wholestage on 10761 / 10776 1.6 641.4 1.4X +generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate explode array wholestage off 15063 16007 1335 1.1 897.8 1.0X +generate explode array wholestage on 10909 10932 20 1.5 650.2 1.4X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -generate explode map: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -generate explode map wholestage off 22128 / 22578 0.8 1318.9 1.0X -generate explode map wholestage on 16421 / 16520 1.0 978.8 1.3X +generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate explode map wholestage off 55011 55580 806 0.3 3278.9 1.0X +generate explode map wholestage on 46009 46445 399 0.4 2742.3 1.2X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -generate posexplode array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -generate posexplode array wholestage off 17108 / 18019 1.0 1019.7 1.0X -generate posexplode array wholestage on 11715 / 11804 1.4 698.3 1.5X +generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate posexplode array wholestage off 17987 18866 1244 0.9 1072.1 1.0X +generate posexplode array wholestage on 11400 11444 38 1.5 679.5 1.6X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -generate inline array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -generate inline array wholestage off 16358 / 16418 1.0 975.0 1.0X -generate inline array wholestage on 11152 / 11472 1.5 664.7 1.5X +generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate inline array wholestage off 14905 14991 122 1.1 888.4 1.0X +generate inline array wholestage on 9919 10129 160 1.7 591.2 1.5X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -generate big struct array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -generate big struct array wholestage off 708 / 776 0.1 11803.5 1.0X -generate big struct array wholestage on 535 / 589 0.1 8913.9 1.3X +generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate big struct array wholestage off 508 577 98 0.1 8474.0 1.0X +generate big struct array wholestage on 451 485 26 0.1 7523.2 1.1X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate big nested struct array wholestage off 540 553 19 0.1 8997.4 1.0X -generate big nested struct array wholestage on 523 554 31 0.1 8725.0 1.0X +generate big nested struct array wholestage off 537 567 43 0.1 8944.4 1.0X +generate big nested struct array wholestage on 528 546 24 0.1 8804.2 1.0X ================================================================================================ generate regular generator ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -generate stack: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -generate stack wholestage off 29082 / 29393 0.6 1733.4 1.0X -generate stack wholestage on 21066 / 21128 0.8 1255.6 1.4X +generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +generate stack wholestage off 27220 27608 548 0.6 1622.5 1.0X +generate stack wholestage on 20070 20170 117 0.8 1196.3 1.4X diff --git a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..4d35f87287 --- /dev/null +++ b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt @@ -0,0 +1,53 @@ +================================================================================================ +Nested Schema Pruning Benchmark For ORC v1 +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 150 192 23 6.7 150.1 1.0X +Nested column 1241 1289 82 0.8 1241.3 0.1X +Nested column in array 5466 5574 114 0.2 5465.6 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 463 515 30 2.2 462.6 1.0X +Nested column 1920 1967 27 0.5 1920.1 0.2X +Nested column in array 6565 6685 123 0.2 6564.8 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 387 431 80 2.6 387.0 1.0X +Nested column 1846 1865 13 0.5 1846.2 0.2X +Nested column in array 6458 6569 114 0.2 6458.2 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 391 405 13 2.6 390.9 1.0X +Nested column 4597 4684 81 0.2 4597.4 0.1X +Nested column in array 9434 9499 54 0.1 9433.9 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 131 165 27 7.6 130.9 1.0X +Nested column 1258 1298 31 0.8 1257.7 0.1X +Nested column in array 5360 5393 16 0.2 5359.7 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 584 632 63 1.7 583.7 1.0X +Nested column 5211 5384 108 0.2 5211.1 0.1X +Nested column in array 10279 10397 94 0.1 10279.0 0.1X + + diff --git a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt index 765193d6c6..0dd85968b9 100644 --- a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt +++ b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v1 ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 127 163 24 7.9 127.1 1.0X -Nested column 974 1023 39 1.0 974.2 0.1X -Nested column in array 4834 4857 23 0.2 4834.1 0.0X +Top-level column 131 167 24 7.6 131.0 1.0X +Nested column 1296 1340 33 0.8 1296.0 0.1X +Nested column in array 5568 5745 243 0.2 5567.8 0.0X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 454 488 45 2.2 454.3 1.0X -Nested column 1539 1602 80 0.6 1539.3 0.3X -Nested column in array 5765 5848 69 0.2 5764.7 0.1X +Top-level column 432 468 33 2.3 431.6 1.0X +Nested column 1778 1828 35 0.6 1777.7 0.2X +Nested column in array 6565 6727 137 0.2 6565.1 0.1X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 365 395 58 2.7 364.9 1.0X -Nested column 1456 1477 23 0.7 1456.0 0.3X -Nested column in array 5734 5842 91 0.2 5734.4 0.1X +Top-level column 365 406 60 2.7 365.3 1.0X +Nested column 1803 1821 22 0.6 1803.2 0.2X +Nested column in array 6453 6530 111 0.2 6453.5 0.1X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 373 387 15 2.7 372.8 1.0X -Nested column 4349 4397 59 0.2 4348.8 0.1X -Nested column in array 8893 8971 73 0.1 8893.2 0.0X +Top-level column 370 390 30 2.7 369.6 1.0X +Nested column 4955 5028 61 0.2 4955.0 0.1X +Nested column in array 10490 10553 49 0.1 10490.5 0.0X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 130 159 24 7.7 129.9 1.0X -Nested column 1160 1216 50 0.9 1159.8 0.1X -Nested column in array 5297 5420 176 0.2 5296.8 0.0X +Top-level column 135 150 18 7.4 134.5 1.0X +Nested column 1615 1717 78 0.6 1615.0 0.1X +Nested column in array 6919 7024 53 0.1 6919.4 0.0X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 585 615 60 1.7 585.5 1.0X -Nested column 4972 5213 156 0.2 4972.2 0.1X -Nested column in array 10095 10156 32 0.1 10095.4 0.1X +Top-level column 580 619 28 1.7 580.4 1.0X +Nested column 5547 5752 185 0.2 5547.3 0.1X +Nested column in array 11639 11838 183 0.1 11639.4 0.0X diff --git a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..0036510d62 --- /dev/null +++ b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt @@ -0,0 +1,53 @@ +================================================================================================ +Nested Schema Pruning Benchmark For ORC v2 +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 150 187 20 6.7 150.2 1.0X +Nested column 1370 1463 104 0.7 1369.8 0.1X +Nested column in array 6575 6656 66 0.2 6575.2 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 134 161 20 7.5 133.7 1.0X +Nested column 1532 1550 15 0.7 1532.4 0.1X +Nested column in array 6601 6688 126 0.2 6601.4 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 409 491 190 2.4 409.5 1.0X +Nested column 1896 1938 60 0.5 1896.2 0.2X +Nested column in array 7414 7472 43 0.1 7414.0 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 408 433 37 2.5 408.1 1.0X +Nested column 4703 4795 101 0.2 4703.4 0.1X +Nested column in array 10477 10556 61 0.1 10476.6 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 130 164 31 7.7 130.3 1.0X +Nested column 1471 1513 44 0.7 1470.5 0.1X +Nested column in array 6492 6551 55 0.2 6492.0 0.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 268 283 14 3.7 268.4 1.0X +Nested column 3347 3401 77 0.3 3347.3 0.1X +Nested column in array 9297 9433 237 0.1 9296.6 0.0X + + diff --git a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt index fdd347f4ba..8aff152f0c 100644 --- a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt +++ b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v2 ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 122 161 29 8.2 121.9 1.0X -Nested column 1255 1279 23 0.8 1255.4 0.1X -Nested column in array 5352 5393 37 0.2 5352.3 0.0X +Top-level column 141 161 22 7.1 140.6 1.0X +Nested column 1425 1455 26 0.7 1424.7 0.1X +Nested column in array 5248 5300 46 0.2 5247.5 0.0X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 132 162 32 7.6 131.8 1.0X -Nested column 1246 1286 32 0.8 1245.6 0.1X -Nested column in array 5395 5542 143 0.2 5394.9 0.0X +Top-level column 133 163 22 7.5 132.8 1.0X +Nested column 1254 1308 40 0.8 1254.0 0.1X +Nested column in array 5303 5418 81 0.2 5303.3 0.0X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 385 403 20 2.6 385.4 1.0X -Nested column 1663 1691 52 0.6 1663.2 0.2X -Nested column in array 6264 6335 73 0.2 6264.4 0.1X +Top-level column 377 401 19 2.7 376.7 1.0X +Nested column 1676 1722 21 0.6 1676.1 0.2X +Nested column in array 6019 6127 109 0.2 6018.7 0.1X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 392 422 58 2.5 392.2 1.0X -Nested column 4104 4153 57 0.2 4104.0 0.1X -Nested column in array 8668 8748 55 0.1 8668.3 0.0X +Top-level column 390 447 151 2.6 390.1 1.0X +Nested column 4300 4364 60 0.2 4299.7 0.1X +Nested column in array 8832 9030 114 0.1 8832.4 0.0X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 130 146 22 7.7 130.1 1.0X -Nested column 1127 1166 53 0.9 1127.3 0.1X -Nested column in array 4906 4968 40 0.2 4905.8 0.0X +Top-level column 132 143 7 7.6 131.6 1.0X +Nested column 1260 1303 20 0.8 1260.2 0.1X +Nested column in array 5359 5453 74 0.2 5359.1 0.0X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 291 308 25 3.4 290.5 1.0X -Nested column 3016 3091 58 0.3 3016.0 0.1X -Nested column in array 7730 7821 140 0.1 7729.5 0.0X +Top-level column 288 302 20 3.5 287.6 1.0X +Nested column 3169 3242 53 0.3 3168.7 0.1X +Nested column in array 8151 8301 123 0.1 8151.3 0.0X diff --git a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..4535220aea --- /dev/null +++ b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt @@ -0,0 +1,53 @@ +================================================================================================ +Nested Schema Pruning Benchmark For Parquet +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 164 191 18 6.1 163.6 1.0X +Nested column 416 444 26 2.4 415.7 0.4X +Nested column in array 1349 1398 39 0.7 1349.4 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 153 169 14 6.5 152.7 1.0X +Nested column 540 566 26 1.9 540.5 0.3X +Nested column in array 1378 1447 87 0.7 1378.0 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 414 433 26 2.4 414.0 1.0X +Nested column 736 777 56 1.4 736.2 0.6X +Nested column in array 1895 1954 86 0.5 1895.2 0.2X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 402 436 49 2.5 402.1 1.0X +Nested column 3190 3225 26 0.3 3190.4 0.1X +Nested column in array 3749 3806 68 0.3 3748.7 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 135 159 25 7.4 134.5 1.0X +Nested column 462 497 36 2.2 462.4 0.3X +Nested column in array 1453 1508 45 0.7 1453.5 0.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Top-level column 277 301 27 3.6 277.3 1.0X +Nested column 2057 2097 33 0.5 2057.3 0.1X +Nested column in array 3027 3134 122 0.3 3027.4 0.1X + + diff --git a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt index 4e0c368b53..182a1aed49 100644 --- a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt +++ b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For Parquet ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 151 174 16 6.6 151.3 1.0X -Nested column 316 375 88 3.2 315.7 0.5X -Nested column in array 1277 1292 11 0.8 1277.0 0.1X +Top-level column 149 183 22 6.7 148.8 1.0X +Nested column 413 436 20 2.4 413.4 0.4X +Nested column in array 1309 1327 24 0.8 1308.9 0.1X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 452 501 67 2.2 451.9 1.0X -Nested column 664 722 77 1.5 664.4 0.7X -Nested column in array 1906 1997 91 0.5 1905.6 0.2X +Top-level column 160 184 17 6.3 159.5 1.0X +Nested column 436 481 77 2.3 436.5 0.4X +Nested column in array 1354 1381 26 0.7 1353.6 0.1X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 385 410 39 2.6 385.5 1.0X -Nested column 612 620 10 1.6 611.9 0.6X -Nested column in array 1790 1845 80 0.6 1789.5 0.2X +Top-level column 378 412 61 2.6 378.0 1.0X +Nested column 744 790 51 1.3 744.0 0.5X +Nested column in array 1915 1987 76 0.5 1915.0 0.2X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 386 402 26 2.6 386.0 1.0X -Nested column 2982 3057 64 0.3 2982.0 0.1X -Nested column in array 3504 3690 248 0.3 3503.7 0.1X +Top-level column 389 407 16 2.6 388.6 1.0X +Nested column 3152 3217 48 0.3 3151.9 0.1X +Nested column in array 3698 3860 274 0.3 3698.2 0.1X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 138 152 10 7.2 138.3 1.0X -Nested column 345 369 16 2.9 344.8 0.4X -Nested column in array 1358 1405 50 0.7 1358.5 0.1X +Top-level column 143 170 27 7.0 142.7 1.0X +Nested column 450 461 8 2.2 449.9 0.3X +Nested column in array 1411 1460 41 0.7 1411.2 0.1X -OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 606 632 45 1.6 606.3 1.0X -Nested column 3586 3679 107 0.3 3585.8 0.2X -Nested column in array 4452 4831 244 0.2 4451.8 0.1X +Top-level column 293 309 22 3.4 292.9 1.0X +Nested column 2109 2142 19 0.5 2109.1 0.1X +Nested column in array 3018 3096 79 0.3 3017.7 0.1X diff --git a/sql/core/benchmarks/PrimitiveArrayBenchmark-jdk11-results.txt b/sql/core/benchmarks/PrimitiveArrayBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..0e5a051d92 --- /dev/null +++ b/sql/core/benchmarks/PrimitiveArrayBenchmark-jdk11-results.txt @@ -0,0 +1,12 @@ +================================================================================================ +Write primitive arrays in dataset +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Write an array in Dataset: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Int 636 681 50 13.2 75.8 1.0X +Double 727 809 71 11.5 86.7 0.9X + + diff --git a/sql/core/benchmarks/PrimitiveArrayBenchmark-results.txt b/sql/core/benchmarks/PrimitiveArrayBenchmark-results.txt index 5fa461fecd..837145e7c9 100644 --- a/sql/core/benchmarks/PrimitiveArrayBenchmark-results.txt +++ b/sql/core/benchmarks/PrimitiveArrayBenchmark-results.txt @@ -6,7 +6,7 @@ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Write an array in Dataset: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Int 543 605 67 15.4 64.7 1.0X -Double 737 776 36 11.4 87.9 0.7X +Int 631 684 65 13.3 75.2 1.0X +Double 792 854 61 10.6 94.4 0.8X diff --git a/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt b/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..dc86fb686f --- /dev/null +++ b/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt @@ -0,0 +1,15 @@ +================================================================================================ +range +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +range: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +full scan 20357 21595 1692 25.8 38.8 1.0X +limit after range 115 130 15 4563.9 0.2 177.2X +filter after range 1890 1906 21 277.5 3.6 10.8X +count after range 85 87 3 6200.7 0.2 240.8X +count after limit after range 101 109 9 5213.9 0.2 202.4X + + diff --git a/sql/core/benchmarks/RangeBenchmark-results.txt b/sql/core/benchmarks/RangeBenchmark-results.txt index 21766e0fd8..7b6daf9b9c 100644 --- a/sql/core/benchmarks/RangeBenchmark-results.txt +++ b/sql/core/benchmarks/RangeBenchmark-results.txt @@ -2,15 +2,14 @@ range ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_161-b12 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz - -range: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -full scan 12674 / 12840 41.4 24.2 1.0X -limit after range 33 / 37 15900.2 0.1 384.4X -filter after range 969 / 985 541.0 1.8 13.1X -count after range 42 / 42 12510.5 0.1 302.4X -count after limit after range 32 / 33 16337.0 0.1 394.9X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +range: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +full scan 19094 19768 459 27.5 36.4 1.0X +limit after range 90 108 19 5803.9 0.2 211.4X +filter after range 1807 1820 12 290.1 3.4 10.6X +count after range 88 93 6 5941.4 0.2 216.4X +count after limit after range 82 86 4 6398.2 0.2 233.0X diff --git a/sql/core/benchmarks/SortBenchmark-jdk11-results.txt b/sql/core/benchmarks/SortBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..a61989b174 --- /dev/null +++ b/sql/core/benchmarks/SortBenchmark-jdk11-results.txt @@ -0,0 +1,16 @@ +================================================================================================ +radix sort +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +radix sort 25000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +reference TimSort key prefix array 15588 15592 6 1.6 623.5 1.0X +reference Arrays.sort 3367 3377 14 7.4 134.7 4.6X +radix sort one byte 436 447 10 57.3 17.5 35.7X +radix sort two bytes 875 885 9 28.6 35.0 17.8X +radix sort eight bytes 3409 3429 27 7.3 136.4 4.6X +radix sort key prefix array 5985 6058 104 4.2 239.4 2.6X + + diff --git a/sql/core/benchmarks/SortBenchmark-results.txt b/sql/core/benchmarks/SortBenchmark-results.txt index 0d00a0c89d..b321d1115b 100644 --- a/sql/core/benchmarks/SortBenchmark-results.txt +++ b/sql/core/benchmarks/SortBenchmark-results.txt @@ -2,16 +2,15 @@ radix sort ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_162-b12 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz - -radix sort 25000000: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -reference TimSort key prefix array 11770 / 11960 2.1 470.8 1.0X -reference Arrays.sort 2106 / 2128 11.9 84.3 5.6X -radix sort one byte 93 / 100 269.7 3.7 126.9X -radix sort two bytes 171 / 179 146.0 6.9 68.7X -radix sort eight bytes 659 / 664 37.9 26.4 17.9X -radix sort key prefix array 1024 / 1053 24.4 41.0 11.5X +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +radix sort 25000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +reference TimSort key prefix array 15736 15778 59 1.6 629.4 1.0X +reference Arrays.sort 3051 3057 10 8.2 122.0 5.2X +radix sort one byte 442 453 10 56.6 17.7 35.6X +radix sort two bytes 883 885 1 28.3 35.3 17.8X +radix sort eight bytes 3422 3440 26 7.3 136.9 4.6X +radix sort key prefix array 6025 6138 159 4.1 241.0 2.6X diff --git a/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt b/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..3454c1bccd --- /dev/null +++ b/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt @@ -0,0 +1,59 @@ +================================================================================================ +UDF with mixed input types +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +long/nullable int/string to string wholestage off 289 302 18 0.3 2893.0 1.0X +long/nullable int/string to string wholestage on 141 165 20 0.7 1405.4 2.1X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +long/nullable int/string to option wholestage off 112 120 11 0.9 1124.6 1.0X +long/nullable int/string to option wholestage on 68 77 8 1.5 681.3 1.7X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +long/nullable int/string to primitive wholestage off 74 79 6 1.3 744.3 1.0X +long/nullable int/string to primitive wholestage on 71 83 10 1.4 713.5 1.0X + + +================================================================================================ +UDF with primitive types +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +long/nullable int to string wholestage off 94 99 6 1.1 942.4 1.0X +long/nullable int to string wholestage on 58 60 1 1.7 584.3 1.6X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +long/nullable int to option wholestage off 43 46 5 2.3 425.7 1.0X +long/nullable int to option wholestage on 42 49 7 2.4 423.2 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +long/nullable int to primitive wholestage off 40 41 1 2.5 401.7 1.0X +long/nullable int to primitive wholestage on 40 44 5 2.5 400.1 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +UDF identity overhead: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Baseline 35 40 6 2.9 348.2 1.0X +With identity UDF 38 38 0 2.6 380.4 0.9X + + diff --git a/sql/core/benchmarks/UDFBenchmark-results.txt b/sql/core/benchmarks/UDFBenchmark-results.txt index 3dfd0c1cae..1490b44396 100644 --- a/sql/core/benchmarks/UDFBenchmark-results.txt +++ b/sql/core/benchmarks/UDFBenchmark-results.txt @@ -2,58 +2,58 @@ UDF with mixed input types ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int/string to string wholestage off 194 248 76 0,5 1941,4 1,0X -long/nullable int/string to string wholestage on 127 136 8 0,8 1269,5 1,5X +long/nullable int/string to string wholestage off 242 308 94 0.4 2416.5 1.0X +long/nullable int/string to string wholestage on 141 179 25 0.7 1410.3 1.7X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int/string to option wholestage off 91 97 8 1,1 910,1 1,0X -long/nullable int/string to option wholestage on 60 79 29 1,7 603,8 1,5X +long/nullable int/string to option wholestage off 91 97 9 1.1 908.1 1.0X +long/nullable int/string to option wholestage on 77 91 12 1.3 774.4 1.2X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int/string to primitive wholestage off 55 63 12 1,8 547,9 1,0X -long/nullable int/string to primitive wholestage on 43 44 2 2,3 428,0 1,3X +long/nullable int/string to primitive wholestage off 68 75 9 1.5 684.7 1.0X +long/nullable int/string to primitive wholestage on 62 64 3 1.6 619.8 1.1X ================================================================================================ UDF with primitive types ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int to string wholestage off 46 48 2 2,2 461,2 1,0X -long/nullable int to string wholestage on 49 56 8 2,0 488,9 0,9X +long/nullable int to string wholestage off 67 68 0 1.5 672.2 1.0X +long/nullable int to string wholestage on 66 72 11 1.5 660.5 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int to option wholestage off 41 47 9 2,4 408,2 1,0X -long/nullable int to option wholestage on 26 28 2 3,9 256,7 1,6X +long/nullable int to option wholestage off 53 57 5 1.9 528.1 1.0X +long/nullable int to option wholestage on 41 44 4 2.4 410.2 1.3X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int to primitive wholestage off 26 27 0 3,8 263,7 1,0X -long/nullable int to primitive wholestage on 26 31 5 3,8 262,2 1,0X +long/nullable int to primitive wholestage off 46 48 4 2.2 459.1 1.0X +long/nullable int to primitive wholestage on 40 40 0 2.5 398.0 1.2X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6 -Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz UDF identity overhead: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Baseline 20 22 1 4,9 204,3 1,0X -With identity UDF 24 26 2 4,1 241,3 0,8X +Baseline 53 58 4 1.9 525.6 1.0X +With identity UDF 38 38 0 2.7 376.3 1.4X diff --git a/sql/core/benchmarks/UnsafeArrayDataBenchmark-jdk11-results.txt b/sql/core/benchmarks/UnsafeArrayDataBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..577cdb0db6 --- /dev/null +++ b/sql/core/benchmarks/UnsafeArrayDataBenchmark-jdk11-results.txt @@ -0,0 +1,33 @@ +================================================================================================ +Benchmark UnsafeArrayData +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Read UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Int 183 184 0 914.7 1.1 1.0X +Double 188 189 0 891.1 1.1 1.0X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Write UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Int 31 32 1 670.0 1.5 1.0X +Double 70 71 1 300.3 3.3 0.4X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Get primitive array from UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Int 71 73 3 887.3 1.1 1.0X +Double 144 151 6 438.2 2.3 0.5X + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +Create UnsafeArrayData from primitive array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Int 69 70 1 906.7 1.1 1.0X +Double 140 142 1 448.8 2.2 0.5X + + diff --git a/sql/core/benchmarks/UnsafeArrayDataBenchmark-results.txt b/sql/core/benchmarks/UnsafeArrayDataBenchmark-results.txt index 4ecc1f1fad..6c4669d7ea 100644 --- a/sql/core/benchmarks/UnsafeArrayDataBenchmark-results.txt +++ b/sql/core/benchmarks/UnsafeArrayDataBenchmark-results.txt @@ -2,32 +2,32 @@ Benchmark UnsafeArrayData ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Read UnsafeArrayData: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Int 233 / 234 718.6 1.4 1.0X -Double 244 / 244 687.0 1.5 1.0X +Read UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Int 183 183 0 919.0 1.1 1.0X +Double 192 196 4 872.4 1.1 0.9X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Write UnsafeArrayData: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Int 32 / 33 658.6 1.5 1.0X -Double 73 / 75 287.0 3.5 0.4X +Write UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Int 33 36 3 639.3 1.6 1.0X +Double 76 79 2 274.6 3.6 0.4X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Get primitive array from UnsafeArrayData: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Int 70 / 72 895.0 1.1 1.0X -Double 141 / 143 446.9 2.2 0.5X +Get primitive array from UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Int 71 76 4 890.8 1.1 1.0X +Double 147 151 6 427.4 2.3 0.5X -OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Create UnsafeArrayData from primitive array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -Int 72 / 73 874.7 1.1 1.0X -Double 145 / 146 433.7 2.3 0.5X +Create UnsafeArrayData from primitive array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +Int 73 75 3 866.8 1.2 1.0X +Double 148 150 1 424.8 2.4 0.5X diff --git a/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt b/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt new file mode 100644 index 0000000000..5ba8e8ff9a --- /dev/null +++ b/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt @@ -0,0 +1,17 @@ +================================================================================================ +projection on wide table +================================================================================================ + +OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +projection on wide table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +split threshold 10 42942 43023 108 0.0 40952.8 1.0X +split threshold 100 37236 37310 93 0.0 35510.9 1.2X +split threshold 1024 12198 12260 56 0.1 11633.1 3.5X +split threshold 2048 9789 9860 76 0.1 9335.2 4.4X +split threshold 4096 10120 10161 63 0.1 9651.0 4.2X +split threshold 8192 9961 9972 7 0.1 9499.1 4.3X +split threshold 65536 58987 59087 95 0.0 56254.5 0.7X + + diff --git a/sql/core/benchmarks/WideTableBenchmark-results.txt b/sql/core/benchmarks/WideTableBenchmark-results.txt index 8c09f9ca11..eeb8c34232 100644 --- a/sql/core/benchmarks/WideTableBenchmark-results.txt +++ b/sql/core/benchmarks/WideTableBenchmark-results.txt @@ -2,16 +2,16 @@ projection on wide table ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_191-b12 on Linux 3.10.0-862.3.2.el7.x86_64 +OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -projection on wide table: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------- -split threshold 10 40571 / 40937 0.0 38691.7 1.0X -split threshold 100 31116 / 31669 0.0 29674.6 1.3X -split threshold 1024 10077 / 10199 0.1 9609.7 4.0X -split threshold 2048 8654 / 8692 0.1 8253.2 4.7X -split threshold 4096 8006 / 8038 0.1 7634.7 5.1X -split threshold 8192 8069 / 8107 0.1 7695.3 5.0X -split threshold 65536 56973 / 57204 0.0 54333.7 0.7X +projection on wide table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------ +split threshold 10 43737 44157 345 0.0 41711.3 1.0X +split threshold 100 33514 35770 1455 0.0 31961.3 1.3X +split threshold 1024 14959 15206 256 0.1 14265.8 2.9X +split threshold 2048 12024 12193 171 0.1 11467.2 3.6X +split threshold 4096 11378 11869 450 0.1 10851.1 3.8X +split threshold 8192 10588 10797 154 0.1 10097.8 4.1X +split threshold 65536 56801 57025 130 0.0 54169.4 0.8X