Dongjoon Hyun 2fa792aa64 [SPARK-34783][K8S] Support remote template files ... ### What changes were proposed in this pull request? This PR aims to support remote driver/executor template files. ### Why are the changes needed? Currently, `KubernetesUtils.loadPodFromTemplate` supports only local files. With this PR, we can do the following. ```bash bin/spark-submit \ ... -c spark.kubernetes.driver.podTemplateFile=s3a://dongjoon/driver.yml \ -c spark.kubernetes.executor.podTemplateFile=s3a://dongjoon/executor.yml \ ... ``` ### Does this PR introduce _any_ user-facing change? Yes, this is an improvement. ### How was this patch tested? Manual testing. Closes #31877 from dongjoon-hyun/SPARK-34783-2. Lead-authored-by: Dongjoon Hyun <dhyun@apple.com> Co-authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dhyun@apple.com>		2021-03-19 08:52:42 -07:00
..
core	[SPARK-34783][K8S] Support remote template files	2021-03-19 08:52:42 -07:00
docker/src/main/dockerfiles/spark	[SPARK-33748][K8S] Respect environment variables and configurations for Python executables	2020-12-15 08:56:45 +09:00
integration-tests	[SPARK-34732][K8S][TESTS] Fix IndexOutOfBoundsException in logForFailedTest when driver is not started	2021-03-13 15:28:02 -08:00