a50959a7f6
## What changes were proposed in this pull request? This change reverts the logic which was introduced as a part of SPARK-24149 and a subsequent followup PR. With existing logic: - Spark fails to launch with HDFS federation enabled while trying to get a path to a logical nameservice. - It gets tokens for unrelated namespaces if they are used in HDFS Federation - Automatic namespace discovery is supported only if these are on the same cluster. Rationale for change: - For accessing data from related namespaces, viewfs should handle getting tokens for spark - For accessing data from unrelated namespaces(user explicitly specifies them using existing configs) as these could be on the same or different cluster. (Please fill in changes proposed in this fix) Revert the changes. ## How was this patch tested? Ran few manual tests and unit test. Closes #24785 from dhruve/bug/SPARK-27937. Authored-by: Dhruve Ashar <dhruveashar@gmail.com> Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com> |
||
|---|---|---|
| .. | ||
| benchmarks | ||
| src | ||
| pom.xml | ||