[SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL
## What changes were proposed in this pull request? Added docs for running spark jobs with Mesos on SSL Closes #23342 from jomach/master. Lead-authored-by: Jorge Machado <jorge.w.machado@hotmail.com> Co-authored-by: Jorge Machado <dxc.machado@extaccount.com> Co-authored-by: Jorge Machado <jorge.machado.ext@kiwigrid.com> Co-authored-by: Jorge Machado <JorgeWilson.Machado@ext.gfk.com> Signed-off-by: Sean Owen <sean.owen@databricks.com>
This commit is contained in:
parent
7c8f4756c3
commit
a888d202ab
|
@ -108,6 +108,19 @@ Please note that if you specify multiple ways to obtain the credentials then the
|
||||||
|
|
||||||
An equivalent order applies for the secret. Essentially we prefer the configuration to be specified directly rather than indirectly by files, and we prefer that configuration settings are used over environment variables.
|
An equivalent order applies for the secret. Essentially we prefer the configuration to be specified directly rather than indirectly by files, and we prefer that configuration settings are used over environment variables.
|
||||||
|
|
||||||
|
### Deploy to a Mesos running on Secure Sockets
|
||||||
|
|
||||||
|
If you want to deploy a Spark Application into a Mesos cluster that is running in a secure mode there are some environment variables that need to be set.
|
||||||
|
|
||||||
|
- `LIBPROCESS_SSL_ENABLED=true` enables SSL communication
|
||||||
|
- `LIBPROCESS_SSL_VERIFY_CERT=false` verifies the ssl certificate
|
||||||
|
- `LIBPROCESS_SSL_KEY_FILE=pathToKeyFile.key` path to key
|
||||||
|
- `LIBPROCESS_SSL_CERT_FILE=pathToCRTFile.crt` the certificate file to be used
|
||||||
|
|
||||||
|
All options can be found at http://mesos.apache.org/documentation/latest/ssl/
|
||||||
|
|
||||||
|
Then submit happens as described in Client mode or Cluster mode below
|
||||||
|
|
||||||
## Uploading Spark Package
|
## Uploading Spark Package
|
||||||
|
|
||||||
When Mesos runs a task on a Mesos slave for the first time, that slave must have a Spark binary
|
When Mesos runs a task on a Mesos slave for the first time, that slave must have a Spark binary
|
||||||
|
|
Loading…
Reference in a new issue