From 4af9e07494b4de99e1e099ff9c04a74fa3f02951 Mon Sep 17 00:00:00 2001 From: Patrick Wendell Date: Sat, 24 May 2014 20:25:58 -0700 Subject: [PATCH] Adding SPARK_LOCAL_DIRS docs --- docs/spark-standalone.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/spark-standalone.md b/docs/spark-standalone.md index eb3211b6b0e4e..489c6e36400df 100644 --- a/docs/spark-standalone.md +++ b/docs/spark-standalone.md @@ -95,6 +95,14 @@ You can optionally configure the cluster further by setting environment variable SPARK_MASTER_OPTS Configuration properties that apply only to the master in the form "-Dx=y" (default: none). + + SPARK_LOCAL_DIRS + + Directory to use for "scratch" space in Spark, including map output files and RDDs that get + stored on disk. This should be on a fast, local disk in your system. It can also be a + comma-separated list of multiple directories on different disks. + + SPARK_WORKER_CORES Total number of cores to allow Spark applications to use on the machine (default: all available cores).