spark-instrumented-optimizer/resource-managers
Li Yichao 640afa49aa [SPARK-20365][YARN] Remove local scheme when add path to ClassPath.
In Spark on YARN, when configuring "spark.yarn.jars" with local jars (jars started with "local" scheme), we will get inaccurate classpath for AM and containers. This is because we don't remove "local" scheme when concatenating classpath. It is OK to run because classpath is separated with ":" and java treat "local" as a separate jar. But we could improve it to remove the scheme.

Updated `ClientSuite` to check "local" is not in the classpath.

cc jerryshao

Author: Li Yichao <lyc@zhihu.com>
Author: Li Yichao <liyichao.good@gmail.com>

Closes #18129 from liyichao/SPARK-20365.
2017-06-01 14:40:05 -07:00
..
mesos [SPARK-20814][MESOS] Restore support for spark.executor.extraClassPath. 2017-05-22 12:34:15 -07:00
yarn [SPARK-20365][YARN] Remove local scheme when add path to ClassPath. 2017-06-01 14:40:05 -07:00