================================================================================================ Nested Schema Pruning Benchmark For Parquet ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 149 183 22 6.7 148.8 1.0X Nested column 413 436 20 2.4 413.4 0.4X Nested column in array 1309 1327 24 0.8 1308.9 0.1X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 160 184 17 6.3 159.5 1.0X Nested column 436 481 77 2.3 436.5 0.4X Nested column in array 1354 1381 26 0.7 1353.6 0.1X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 378 412 61 2.6 378.0 1.0X Nested column 744 790 51 1.3 744.0 0.5X Nested column in array 1915 1987 76 0.5 1915.0 0.2X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 389 407 16 2.6 388.6 1.0X Nested column 3152 3217 48 0.3 3151.9 0.1X Nested column in array 3698 3860 274 0.3 3698.2 0.1X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 143 170 27 7.0 142.7 1.0X Nested column 450 461 8 2.2 449.9 0.3X Nested column in array 1411 1460 41 0.7 1411.2 0.1X OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 293 309 22 3.4 292.9 1.0X Nested column 2109 2142 19 0.5 2109.1 0.1X Nested column in array 3018 3096 79 0.3 3017.7 0.1X