Rajat Ahuja ced8e0e662 [SPARK-29465][YARN][WEBUI] Adding Check to not to set UI port (spark.ui.port) property if mentioned explicitly ... ## What changes were proposed in this pull request? When a Spark Job launched in Cluster mode with Yarn, Application Master sets spark.ui.port port to 0 which means Driver's web UI gets any random port even if we want to explicitly set the Port range for Driver's Web UI ## Why are the changes needed? We access Spark Web UI via Knox Proxy, and there are firewall restrictions due to which we can not access Spark Web UI since Web UI port range gets random port even if we set explicitly. This Change will check if there is a specified port range explicitly mentioned so that it does not assign a random port. ## Does this PR introduce any user-facing change? No ## How was this patch tested? Local Tested. Closes #28880 from rajatahujaatinmobi/ahujarajat261/SPARK-32039-change-yarn-webui-port-range-with-property-latest-spark. Authored-by: Rajat Ahuja <rahuja@twitter.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>		2020-07-01 18:28:14 -07:00
..
kubernetes	[SPARK-32058][BUILD] Use Apache Hadoop 3.2.0 dependency by default	2020-06-26 19:43:29 -07:00
mesos	[SPARK-18886][CORE] Make Locality wait time measure resource under utilization due to delay scheduling	2020-04-09 11:00:29 +00:00
yarn	[SPARK-29465][YARN][WEBUI] Adding Check to not to set UI port (spark.ui.port) property if mentioned explicitly	2020-07-01 18:28:14 -07:00