diff --git a/docs/cluster-overview.md b/docs/cluster-overview.md index cb6d3a5c1f..69ae1b6cdb 100644 --- a/docs/cluster-overview.md +++ b/docs/cluster-overview.md @@ -65,7 +65,7 @@ The system currently supports several cluster managers: * [Standalone](spark-standalone.html) -- a simple cluster manager included with Spark that makes it easy to set up a cluster. * [Apache Mesos](running-on-mesos.html) -- a general cluster manager that can also run Hadoop MapReduce - and service applications. + and service applications. (Deprecated) * [Hadoop YARN](running-on-yarn.html) -- the resource manager in Hadoop 2. * [Kubernetes](running-on-kubernetes.html) -- an open-source system for automating deployment, scaling, and management of containerized applications. diff --git a/docs/core-migration-guide.md b/docs/core-migration-guide.md index 8cd7bca325..bb62238632 100644 --- a/docs/core-migration-guide.md +++ b/docs/core-migration-guide.md @@ -32,6 +32,8 @@ license: | - In Spark 3.2, `spark.launcher.childConectionTimeout` is deprecated (typo) though still works. Use `spark.launcher.childConnectionTimeout` instead. +- In Spark 3.2, support for Apache Mesos as a resource manager is deprecated and will be removed in a future version. + ## Upgrading from Core 3.0 to 3.1 - In Spark 3.0 and below, `SparkContext` can be created in executors. Since Spark 3.1, an exception will be thrown when creating `SparkContext` in executors. You can allow it by setting the configuration `spark.executor.allowSparkContext` when creating `SparkContext` in executors. diff --git a/docs/index.md b/docs/index.md index 84f760fe67..de30186141 100644 --- a/docs/index.md +++ b/docs/index.md @@ -99,7 +99,7 @@ Spark can run both by itself, or over several existing cluster managers. It curr options for deployment: * [Standalone Deploy Mode](spark-standalone.html): simplest way to deploy Spark on a private cluster -* [Apache Mesos](running-on-mesos.html) +* [Apache Mesos](running-on-mesos.html) (deprecated) * [Hadoop YARN](running-on-yarn.html) * [Kubernetes](running-on-kubernetes.html) diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index 364def8923..bd01639ea7 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -19,6 +19,8 @@ license: | --- * This will become a table of contents (this text will be scraped). {:toc} + +*Note*: Apache Mesos support is deprecated as of Apache Spark 3.2.0. It will be removed in a future version. Spark can run on hardware clusters managed by [Apache Mesos](http://mesos.apache.org/).