From 3f8e51bbb82669b43d7d52ece09ac957b35e994e Mon Sep 17 00:00:00 2001 From: Andrew Or Date: Mon, 4 Aug 2014 18:46:29 -0700 Subject: [PATCH] Correct erroneous docs... --- docs/spark-standalone.md | 56 ++++++++++++++++++++-------------------- 1 file changed, 28 insertions(+), 28 deletions(-) diff --git a/docs/spark-standalone.md b/docs/spark-standalone.md index e80f2ec9861ed..29628747de410 100644 --- a/docs/spark-standalone.md +++ b/docs/spark-standalone.md @@ -311,7 +311,7 @@ configure those ports. Browser - Standalone Cluster Master + Master 8080 Web UI master.ui.port @@ -343,59 +343,59 @@ configure those ports. - Application - Standalone Cluster Master + Driver
Worker + Master 7077 - Submit job to cluster - spark.driver.port - Akka-based. Set to "0" to choose a port randomly + Submit job to cluster
Join cluster + SPARK_MASTER_PORT + Akka-based. Set to "0" to choose a port randomly. + Master Worker - Standalone Cluster Master - 7077 - Join cluster - spark.driver.port - Akka-based. Set to "0" to choose a port randomly + (random) + Schedule executors + SPARK_WORKER_PORT + Akka-based. Set to "0" to choose a port randomly. - Application - Worker + Executor
Master + Driver (random) - Join cluster - SPARK_WORKER_PORT (standalone cluster) - Akka-based + Connect to application
Notify Master and executor state changes + spark.driver.port + Akka-based. Set to "0" to choose a port randomly. - Worker - Application + Executor + Driver (random) File server for files and jars spark.fileserver.port Jetty-based - Worker - Application + Executor + Driver (random) HTTP Broadcast spark.broadcast.port - Jetty-based. Not used by TorrentBroadcast, which sends data through the block manager - instead + Jetty-based. Not used by TorrentBroadcast, which sends data through the block manager + instead. - Worker - Spark Shell + Executor + Driver (random) - Class file server (Spark Shell only) + Class file server spark.replClassServer.port - Jetty-based + Jetty-based. Only used in Spark shells. - Worker - Other Workers + Executor + Executor (random) Block Manager port spark.blockManager.port