spark-instrumented-optimizer/core
Aaron Davidson 8867cd0bc2 SPARK-1097: Do not introduce deadlock while fixing concurrency bug
We recently added this lock on 'conf' in order to prevent concurrent creation. However, it turns out that this can introduce a deadlock because Hadoop also synchronizes on the Configuration objects when creating new Configurations (and they do so via a static REGISTRY which contains all created Configurations).

This fix forces all Spark initialization of Configuration objects to occur serially by using a static lock that we control, and thus also prevents introducing the deadlock.

Author: Aaron Davidson <aaron@databricks.com>

Closes #1409 from aarondav/1054 and squashes the following commits:

7d1b769 [Aaron Davidson] SPARK-1097: Do not introduce deadlock while fixing concurrency bug
2014-07-16 14:10:17 -07:00
..
src SPARK-1097: Do not introduce deadlock while fixing concurrency bug 2014-07-16 14:10:17 -07:00
pom.xml [SPARK-2399] Add support for LZ4 compression. 2014-07-15 01:46:57 -07:00