9063b17f3d
## What changes were proposed in this pull request? Refactor `ColumnarBatchBenchmark` to use main method. Generate benchmark result: ``` SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "sql/test:runMain org.apache.spark.sql.execution.vectorized.ColumnarBatchBenchmark" ``` ## How was this patch tested? manual tests Closes #22490 from yucai/SPARK-25481. Lead-authored-by: yucai <yyu1@ebay.com> Co-authored-by: Yucai Yu <yucai.yu@foxmail.com> Co-authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
60 lines
3.8 KiB
Plaintext
60 lines
3.8 KiB
Plaintext
================================================================================================
|
|
Int Read/Write
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
|
|
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
|
|
Int Read/Write: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------
|
|
Java Array 244 / 244 1342.3 0.7 1.0X
|
|
ByteBuffer Unsafe 445 / 445 736.5 1.4 0.5X
|
|
ByteBuffer API 2124 / 2125 154.3 6.5 0.1X
|
|
DirectByteBuffer 750 / 750 437.2 2.3 0.3X
|
|
Unsafe Buffer 234 / 236 1401.3 0.7 1.0X
|
|
Column(on heap) 245 / 245 1335.6 0.7 1.0X
|
|
Column(off heap) 489 / 489 670.3 1.5 0.5X
|
|
Column(off heap direct) 236 / 236 1388.1 0.7 1.0X
|
|
UnsafeRow (on heap) 532 / 534 616.0 1.6 0.5X
|
|
UnsafeRow (off heap) 564 / 565 580.7 1.7 0.4X
|
|
Column On Heap Append 489 / 489 670.6 1.5 0.5X
|
|
|
|
|
|
================================================================================================
|
|
Boolean Read/Write
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
|
|
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
|
|
Boolean Read/Write: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------
|
|
Bitset 879 / 879 381.9 2.6 1.0X
|
|
Byte Array 794 / 794 422.6 2.4 1.1X
|
|
|
|
|
|
================================================================================================
|
|
String Read/Write
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
|
|
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
|
|
String Read/Write: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------
|
|
On Heap 449 / 449 36.5 27.4 1.0X
|
|
Off Heap 679 / 679 24.1 41.4 0.7X
|
|
|
|
|
|
================================================================================================
|
|
Array Vector Read
|
|
================================================================================================
|
|
|
|
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
|
|
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
|
|
Array Vector Read: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
|
|
------------------------------------------------------------------------------------------------
|
|
On Heap Read Size Only 713 / 713 229.8 4.4 1.0X
|
|
Off Heap Read Size Only 757 / 757 216.5 4.6 0.9X
|
|
On Heap Read Elements 3648 / 3650 44.9 22.3 0.2X
|
|
Off Heap Read Elements 5263 / 5265 31.1 32.1 0.1X
|
|
|
|
|