2019-10-03 11:58:25 -04:00
|
|
|
================================================================================================
|
|
|
|
Nested Schema Pruning Benchmark For Parquet
|
|
|
|
================================================================================================
|
|
|
|
|
2021-04-03 16:02:56 -04:00
|
|
|
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
|
|
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
2019-10-03 11:58:25 -04:00
|
|
|
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
|
|
------------------------------------------------------------------------------------------------------------------------
|
2021-04-03 16:02:56 -04:00
|
|
|
Top-level column 72 103 23 13.9 71.8 1.0X
|
|
|
|
Nested column 351 372 22 2.8 351.2 0.2X
|
|
|
|
Nested column in array 1563 1664 57 0.6 1563.3 0.0X
|
2019-10-03 11:58:25 -04:00
|
|
|
|
2021-04-03 16:02:56 -04:00
|
|
|
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
|
|
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
2019-10-03 11:58:25 -04:00
|
|
|
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
|
|
------------------------------------------------------------------------------------------------------------------------
|
2021-04-03 16:02:56 -04:00
|
|
|
Top-level column 380 453 68 2.6 379.8 1.0X
|
|
|
|
Nested column 729 818 70 1.4 728.8 0.5X
|
|
|
|
Nested column in array 2161 2404 173 0.5 2160.9 0.2X
|
2019-10-03 11:58:25 -04:00
|
|
|
|
2021-04-03 16:02:56 -04:00
|
|
|
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
|
|
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
2019-10-03 11:58:25 -04:00
|
|
|
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
|
|
------------------------------------------------------------------------------------------------------------------------
|
2021-04-03 16:02:56 -04:00
|
|
|
Top-level column 315 358 50 3.2 315.2 1.0X
|
|
|
|
Nested column 617 678 40 1.6 616.9 0.5X
|
|
|
|
Nested column in array 2032 2149 112 0.5 2031.8 0.2X
|
2019-10-03 11:58:25 -04:00
|
|
|
|
2021-04-03 16:02:56 -04:00
|
|
|
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
|
|
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
2019-10-03 11:58:25 -04:00
|
|
|
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
|
|
------------------------------------------------------------------------------------------------------------------------
|
2021-04-03 16:02:56 -04:00
|
|
|
Top-level column 306 348 39 3.3 305.6 1.0X
|
|
|
|
Nested column 713 762 40 1.4 713.1 0.4X
|
|
|
|
Nested column in array 2364 2452 58 0.4 2364.3 0.1X
|
2019-10-03 11:58:25 -04:00
|
|
|
|
2021-04-03 16:02:56 -04:00
|
|
|
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
|
|
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
2019-10-03 11:58:25 -04:00
|
|
|
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
|
|
------------------------------------------------------------------------------------------------------------------------
|
2021-04-03 16:02:56 -04:00
|
|
|
Top-level column 106 143 45 9.4 106.2 1.0X
|
|
|
|
Nested column 427 460 42 2.3 427.3 0.2X
|
|
|
|
Nested column in array 1739 1864 91 0.6 1738.8 0.1X
|
2019-10-03 11:58:25 -04:00
|
|
|
|
2021-04-03 16:02:56 -04:00
|
|
|
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
|
|
|
|
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
2019-10-03 11:58:25 -04:00
|
|
|
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
|
|
|
|
------------------------------------------------------------------------------------------------------------------------
|
2021-04-03 16:02:56 -04:00
|
|
|
Top-level column 520 581 39 1.9 519.6 1.0X
|
|
|
|
Nested column 983 1063 71 1.0 983.3 0.5X
|
|
|
|
Nested column in array 2538 2687 146 0.4 2538.0 0.2X
|
2019-10-03 11:58:25 -04:00
|
|
|
|
|
|
|
|