spark-instrumented-optimizer/sql/hive
Josh Rosen 1b0099fc62 [SPARK-9411] [SQL] Make Tungsten page sizes configurable
We need to make page sizes configurable so we can reduce them in unit tests and increase them in real production workloads.  These sizes are now controlled by a new configuration, `spark.buffer.pageSize`.  The new default is 64 megabytes.

Author: Josh Rosen <joshrosen@databricks.com>

Closes #7741 from JoshRosen/SPARK-9411 and squashes the following commits:

a43c4db [Josh Rosen] Fix pow
2c0eefc [Josh Rosen] Fix MAXIMUM_PAGE_SIZE_BYTES comment + value
bccfb51 [Josh Rosen] Lower page size to 4MB in TestHive
ba54d4b [Josh Rosen] Make UnsafeExternalSorter's page size configurable
0045aa2 [Josh Rosen] Make UnsafeShuffle's page size configurable
bc734f0 [Josh Rosen] Rename configuration
e614858 [Josh Rosen] Makes BytesToBytesMap page size configurable
2015-07-29 16:00:30 -07:00
..
compatibility/src/test/scala/org/apache/spark/sql/hive/execution [SPARK-9418][SQL] Use sort-merge join as the default shuffle join. 2015-07-28 17:42:35 -07:00
src [SPARK-9411] [SQL] Make Tungsten page sizes configurable 2015-07-29 16:00:30 -07:00
pom.xml [SPARK-9015] [BUILD] Clean project import in scala ide 2015-07-16 18:42:41 +01:00