Skip to content

Commit

Permalink
[SPARK-11857][MESOS] Deprecate fine grained
Browse files Browse the repository at this point in the history
## What changes were proposed in this pull request?

Documentation changes to indicate that fine-grained mode is now deprecated.  No code changes were made, and all fine-grained mode instructions were left in place.  We can remove all of that once the deprecation cycle completes (Does Spark have a standard deprecation cycle?  One major version?)

Blocked on #14059

## How was this patch tested?

Viewed in Github

Author: Michael Gummelt <[email protected]>

Closes #14078 from mgummelt/deprecate-fine-grained.

(cherry picked from commit b1db26a)
Signed-off-by: Reynold Xin <[email protected]>
  • Loading branch information
Michael Gummelt authored and rxin committed Jul 9, 2016
1 parent 5024c4c commit 50d7002
Showing 1 changed file with 7 additions and 2 deletions.
9 changes: 7 additions & 2 deletions docs/running-on-mesos.md
Original file line number Diff line number Diff line change
Expand Up @@ -181,7 +181,7 @@ Note that jars or python files that are passed to spark-submit should be URIs re
# Mesos Run Modes

Spark can run over Mesos in two modes: "coarse-grained" (default) and
"fine-grained".
"fine-grained" (deprecated).

## Coarse-Grained

Expand Down Expand Up @@ -213,7 +213,12 @@ the application. To configure your job to dynamically adjust to its
resource requirements, look into
[Dynamic Allocation](#dynamic-resource-allocation-with-mesos).

## Fine-Grained
## Fine-Grained (deprecated)

**NOTE:** Fine-grained mode is deprecated as of Spark 2.0.0. Consider
using [Dynamic Allocation](#dynamic-resource-allocation-with-mesos)
for some of the benefits. For a full explanation see
[SPARK-11857](https://issues.apache.org/jira/browse/SPARK-11857)

In "fine-grained" mode, each Spark task inside the Spark executor runs
as a separate Mesos task. This allows multiple instances of Spark (and
Expand Down

0 comments on commit 50d7002

Please sign in to comment.