================================================================================================ Nested Schema Pruning Benchmark For Parquet ================================================================================================ OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 164 191 18 6.1 163.6 1.0X Nested column 416 444 26 2.4 415.7 0.4X Nested column in array 1349 1398 39 0.7 1349.4 0.1X OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 153 169 14 6.5 152.7 1.0X Nested column 540 566 26 1.9 540.5 0.3X Nested column in array 1378 1447 87 0.7 1378.0 0.1X OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 414 433 26 2.4 414.0 1.0X Nested column 736 777 56 1.4 736.2 0.6X Nested column in array 1895 1954 86 0.5 1895.2 0.2X OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 402 436 49 2.5 402.1 1.0X Nested column 3190 3225 26 0.3 3190.4 0.1X Nested column in array 3749 3806 68 0.3 3748.7 0.1X OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 135 159 25 7.4 134.5 1.0X Nested column 462 497 36 2.2 462.4 0.3X Nested column in array 1453 1508 45 0.7 1453.5 0.1X OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Top-level column 277 301 27 3.6 277.3 1.0X Nested column 2057 2097 33 0.5 2057.3 0.1X Nested column in array 3027 3134 122 0.3 3027.4 0.1X