From ce483d76a1d524800859764b967c8b5a98fbd9ea Mon Sep 17 00:00:00 2001 From: Gil Vernik Date: Sun, 8 Jun 2014 10:34:04 +0300 Subject: [PATCH] SPARK-938 - Openstack Swift object storage support This is initial documentation describing how to integrate Spark with Swift. This commit contains documentation for stand alone cluster. Next patches will contain details how to integrate Swift in other deployment of Spark. --- docs/openstack-integration.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/openstack-integration.md b/docs/openstack-integration.md index 42cd3067edf80..ca422d298cc11 100644 --- a/docs/openstack-integration.md +++ b/docs/openstack-integration.md @@ -60,7 +60,7 @@ Create core-sites.xml and place it under /spark/conf directory. Configure core-s true -We left with `fs.swift.service..tenant`, `fs.swift.service..username`, `fs.swift.service..password`. The best way is to provide them to SparkContext in run time, which seems to be impossible yet. +We left with `fs.swift.service..tenant`, `fs.swift.service..username`, `fs.swift.service..password`. The best way to provide those parameters to SparkContext in run time, which seems to be impossible yet. Another approach is to change Hadoop Swift FS driver to provide them via system environment variables. For now we provide them via core-sites.xml