Skip to content

Latest commit

 

History

History
71 lines (51 loc) · 2.91 KB

using_releases.md

File metadata and controls

71 lines (51 loc) · 2.91 KB

Documentation

Using a release

Long story short, there are several ways to start the Spark Notebook quickly:

However, there are several flavors for these distributions that depends on the Spark version and Hadoop version you are using.

Requirements

  • Make sure you're running at least Java 7 (sudo apt-get install openjdk-7-jdk).

Preferred way

Head to http://spark-notebook.io and download a pre-built/pre-packaged installation for your specific configuration and format of choice. On http://spark-notebook.io it is possible to requests builds for specific combinations of Scala and Spark versions, different Hadoop releases and add/remove support for Hive and Parquet.

You'll be presented a form to get the distribution you want. If not available, it'll gracefully build it for you and notify you want it'll be ready

Check the related section for instructions on how to use it (although it's very easy).

ZIP/TGZ

Here is an example for zip

# Downloaded spark-notebook-0.6.0-scala-2.10.5-spark-1.6.1-hadoop-2.0.0.zip
unzip spark-notebook-0.6.0-scala-2.10.5-spark-1.6.1-hadoop-2.0.0.zip
cd spark-notebook-0.6.0-scala-2.10.5-spark-1.6.1-hadoop-2.0.0
./bin/spark-notebook

Here is an example for tgz "tarbal"

# Downloaded spark-notebook-0.6.0-scala-2.10.5-spark-1.6.1-hadoop-2.0.0.zip
tar -xvf spark-notebook-0.6.0-scala-2.10.5-spark-1.6.1-hadoop-2.0.0.tgz
cd spark-notebook-0.6.0-scala-2.10.5-spark-1.6.1-hadoop-2.0.0
./bin/spark-notebook

Docker

If you're a Docker user, the following procedure will be even simpler!

Checkout the needed version here.

docker pull andypetrella/spark-notebook:0.6.0-scala-2.10.4-spark-1.4.1-hadoop-2.4.0
docker run -p 9001:9001 andypetrella/spark-notebook:0.6.0-scala-2.10.4-spark-1.4.1-hadoop-2.4.0
Note: boot2docker (Mac OS X)

On Mac OS X, you need something like boot2docker to use docker. However, port forwarding needs an extra command necessary for it to work (cf this and this SO questions).

VBoxManage modifyvm "boot2docker-vm" --natpf1 "tcp-port9001,tcp,,9001,,9001"

DEB

For Debian/Ubuntu based distros, the Spark Notebook is also avaiable as a Debian package for download. After downloading, use your package manager to install

# Downloaded spark-notebook-0.6.0-scala-2.10.5-spark-1.6.1-hadoop-2.0.0.deb
sudo dpkg -i spark-notebook-0.6.0-scala-2.10.5-spark-1.6.1-hadoop-2.0.0.deb
sudo spark-notebook