spark-instrumented-optimizer/sql/hive
Maxim Gekk aff8f15c15 [SPARK-25240][SQL] Fix for a deadlock in RECOVER PARTITIONS
## What changes were proposed in this pull request?

In the PR, I propose to not perform recursive parallel listening of files in the `scanPartitions` method because it can cause a deadlock. Instead of that I propose to do `scanPartitions` in parallel for top level partitions only.

## How was this patch tested?

I extended an existing test to trigger the deadlock.

Author: Maxim Gekk <maxim.gekk@databricks.com>

Closes #22233 from MaxGekk/fix-recover-partitions.
2018-08-28 11:29:05 -07:00
..
compatibility/src/test/scala/org/apache/spark/sql/hive/execution [SPARK-19355][SQL] Use map output statistics to improve global limit's parallelism 2018-08-10 11:32:15 +02:00
src [SPARK-25240][SQL] Fix for a deadlock in RECOVER PARTITIONS 2018-08-28 11:29:05 -07:00
pom.xml [SPARK-23028] Bump master branch version to 2.4.0-SNAPSHOT 2018-01-13 00:37:59 +08:00