669ade3a8e
## What changes were proposed in this pull request? Refactor `HashBenchmark` to use main method. 1. use `spark-submit`: ```console bin/spark-submit --class org.apache.spark.sql.HashBenchmark --jars ./core/target/spark-core_2.11-3.0.0-SNAPSHOT-tests.jar ./sql/catalyst/target/spark-catalyst_2.11-3.0.0-SNAPSHOT-tests.jar ``` 2. Generate benchmark result: ```console SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "catalyst/test:runMain org.apache.spark.sql.HashBenchmark" ``` ## How was this patch tested? manual tests Closes #22651 from wangyum/SPARK-25657. Lead-authored-by: Yuming Wang <wgyumg@gmail.com> Co-authored-by: Yuming Wang <yumwang@ebay.com> Co-authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
71 lines
4.4 KiB
Plaintext
71 lines
4.4 KiB
Plaintext
================================================================================================
|
|
single ints
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
|
|
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
|
|
Hash For single ints: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------
|
|
interpreted version 5615 / 5616 95.6 10.5 1.0X
|
|
codegen version 8400 / 8407 63.9 15.6 0.7X
|
|
codegen version 64-bit 8139 / 8145 66.0 15.2 0.7X
|
|
codegen HiveHash version 7213 / 7348 74.4 13.4 0.8X
|
|
|
|
|
|
================================================================================================
|
|
single longs
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
|
|
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
|
|
Hash For single longs: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------
|
|
interpreted version 6053 / 6054 88.7 11.3 1.0X
|
|
codegen version 9367 / 9369 57.3 17.4 0.6X
|
|
codegen version 64-bit 8041 / 8051 66.8 15.0 0.8X
|
|
codegen HiveHash version 7546 / 7575 71.1 14.1 0.8X
|
|
|
|
|
|
================================================================================================
|
|
normal
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
|
|
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
|
|
Hash For normal: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------
|
|
interpreted version 3181 / 3182 0.7 1517.0 1.0X
|
|
codegen version 2403 / 2403 0.9 1145.7 1.3X
|
|
codegen version 64-bit 915 / 916 2.3 436.2 3.5X
|
|
codegen HiveHash version 4505 / 4527 0.5 2148.3 0.7X
|
|
|
|
|
|
================================================================================================
|
|
array
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
|
|
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
|
|
Hash For array: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------
|
|
interpreted version 1828 / 1844 0.1 13946.1 1.0X
|
|
codegen version 3678 / 3804 0.0 28058.2 0.5X
|
|
codegen version 64-bit 2925 / 2931 0.0 22317.8 0.6X
|
|
codegen HiveHash version 1216 / 1217 0.1 9280.0 1.5X
|
|
|
|
|
|
================================================================================================
|
|
map
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
|
|
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
|
|
Hash For map: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------
|
|
interpreted version 0 / 0 44.3 22.6 1.0X
|
|
codegen version 176 / 176 0.0 42978.8 0.0X
|
|
codegen version 64-bit 173 / 175 0.0 42214.3 0.0X
|
|
codegen HiveHash version 44 / 44 0.1 10659.9 0.0X
|
|
|
|
|