jerryshao cde64add18 [SPARK-21411][YARN] Lazily create FS within kerberized UGI to avoid token acquiring failure ... ## What changes were proposed in this pull request? In the current `YARNHadoopDelegationTokenManager`, `FileSystem` to which to get tokens are created out of KDC logged UGI, using these `FileSystem` to get new tokens will lead to exception. The main thing is that Spark code trying to get new tokens from the FS created with token auth-ed UGI, but Hadoop can only grant new tokens in kerberized UGI. To fix this issue, we should lazily create these FileSystem within KDC logged UGI. ## How was this patch tested? Manual verification in secure cluster. CC vanzin mgummelt please help to review, thanks! Author: jerryshao <sshao@hortonworks.com> Closes #18633 from jerryshao/SPARK-21411.		2017-07-18 11:44:01 -07:00
..
src	[SPARK-21411][YARN] Lazily create FS within kerberized UGI to avoid token acquiring failure	2017-07-18 11:44:01 -07:00
pom.xml	[SPARK-20434][YARN][CORE] Move Hadoop delegation token code from yarn to core	2017-06-15 11:46:00 -07:00