spark-instrumented-optimizer/core/src/test
Marco Gaido 3c96937c7b [SPARK-24948][SHS] Delegate check access permissions to the file system
## What changes were proposed in this pull request?

In `SparkHadoopUtil. checkAccessPermission`,  we consider only basic permissions in order to check wether a user can access a file or not. This is not a complete check, as it ignores ACLs and other policies a file system may apply in its internal. So this can result in returning wrongly that a user cannot access a file (despite he actually can).

The PR proposes to delegate to the filesystem the check whether a file is accessible or not, in order to return the right result. A caching layer is added for performance reasons.

## How was this patch tested?

modified UTs

Author: Marco Gaido <marcogaido91@gmail.com>

Closes #21895 from mgaido91/SPARK-24948.
2018-08-06 14:29:05 -07:00
..
java [SPARK-24564][TEST] Add test suite for RecordBinaryComparator 2018-06-28 14:19:50 +08:00
resources [SPARK-23189][CORE][WEB UI] Reflect stage level blacklisting on executor tab 2018-02-13 09:54:52 -06:00
scala/org/apache [SPARK-24948][SHS] Delegate check access permissions to the file system 2018-08-06 14:29:05 -07:00