Shahin Shakeri b573f23ed1 [SPARK-29574][K8S] Add SPARK_DIST_CLASSPATH to the executor class path ... ### What changes were proposed in this pull request? Include `$SPARK_DIST_CLASSPATH` in class path when launching `CoarseGrainedExecutorBackend` on Kubernetes executors using the provided `entrypoint.sh` ### Why are the changes needed? For user provided Hadoop, `$SPARK_DIST_CLASSPATH` contains the required jars. ### Does this PR introduce any user-facing change? no ### How was this patch tested? Kubernetes 1.14, Spark 2.4.4, Hadoop 3.2.1. Adding $SPARK_DIST_CLASSPATH to `-cp ` param of entrypoint.sh enables launching the executors correctly. Closes #26493 from sshakeri/master. Authored-by: Shahin Shakeri <shahin.shakeri@pwc.com> Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com>		2019-12-16 10:11:50 -08:00
..
kubernetes	[SPARK-29574][K8S] Add SPARK_DIST_CLASSPATH to the executor class path	2019-12-16 10:11:50 -08:00
mesos	[MINOR][TESTS] Replace JVM assert with JUnit Assert in tests	2019-11-20 14:04:15 -06:00
yarn	[SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars	2019-11-15 16:17:24 -08:00