spark-instrumented-optimizer/core/src/test
Vyacheslav Baranov c13da20a55 [SPARK-8309] [CORE] Support for more than 12M items in OpenHashMap
The problem occurs because the position mask `0xEFFFFFF` is incorrect. It has zero 25th bit, so when capacity grows beyond 2^24, `OpenHashMap` calculates incorrect index of value in `_values` array.

I've also added a size check in `rehash()`, so that it fails instead of reporting invalid item indices.

Author: Vyacheslav Baranov <slavik.baranov@gmail.com>

Closes #6763 from SlavikBaranov/SPARK-8309 and squashes the following commits:

8557445 [Vyacheslav Baranov] Resolved review comments
4d5b954 [Vyacheslav Baranov] Resolved review comments
eaf1e68 [Vyacheslav Baranov] Fixed failing test
f9284fd [Vyacheslav Baranov] Resolved review comments
3920656 [Vyacheslav Baranov] SPARK-8309: Support for more than 12M items in OpenHashMap
2015-06-17 09:42:29 +01:00
..
java [SPARK-7910] [TINY] [JAVAAPI] expose partitioner information in javardd 2015-05-29 14:59:18 -07:00
resources [SPARK-7161] [HISTORY SERVER] Provide REST api to download event logs fro... 2015-06-03 13:43:13 -05:00
scala/org/apache [SPARK-8309] [CORE] Support for more than 12M items in OpenHashMap 2015-06-17 09:42:29 +01:00