Skip to content
This repository has been archived by the owner on Feb 3, 2021. It is now read-only.

Commit

Permalink
Feature: getting started script (#475)
Browse files Browse the repository at this point in the history
* initial changes for getting started scripts

* add temp error handling

* rename file - fix typo

* add debug strings

* add handling for existing user

* WIP: wait for subprocess to complete to get exit code

* WIP: handle existing user and refactor code

* WIP: add missing return statements

* WIP: fix typo

* start sdk refactor

* mostly working create

* working happy create path

* handle errors for vnet, aad application

* make account setup interactive

* add prompt

* add docs

* rename account_setup_refac to account_setup

* add some logging

* pip install msrest, azure-cli-core, import issues

* remove in script pip, add shell wrapper program

* ellipsis to period

* update branch name for account_setup.sh

* docstring

* retry resource group creation

* fix typo, update retry

* explicitly set output location

* wget overwrite flag, docs update

* add prompt for multi tenants

* fix bug with batch account creation

* add spinner, print statements, fix formatting bug

* fix param bug
  • Loading branch information
jafreck authored Apr 11, 2018
1 parent 44a0765 commit 7ef721f
Show file tree
Hide file tree
Showing 6 changed files with 494 additions and 50 deletions.
28 changes: 12 additions & 16 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,28 +16,24 @@ This toolkit is built on top of Azure Batch but does not require any Azure Batch
- Ability to run _spark submit_ directly from your local machine's CLI

## Setup
1. Clone the repo
```bash
git clone -b stable https://www.github.com/azure/aztk

# You can also clone directly from master to get the latest bits
git clone https://www.github.com/azure/aztk
```
2. Use pip to install required packages (requires python 3.5+ and pip 9.0.1+)
```bash
pip install -r requirements.txt
```
3. Use setuptools:
1. Install `aztk` with pip:
```bash
pip install -e .
pip install aztk
```
4. Initialize the project in a directory [This will automatically create a *.aztk* folder with config files in your working directory]:
2. Initialize the project in a directory. This will automatically create a *.aztk* folder with config files in your working directory:
```bash
aztk spark init
```
5. Fill in the fields for your Batch account and Storage account in your *.aztk/secrets.yaml* file. (We'd also recommend that you enter SSH key info in this file)
3. Login or register for an [Azure Account](https://azure.microsoft.com), navigate to [Azure Cloud Shell](https://shell.azure.com), and run:
```sh
wget -q https://raw.githubusercontent.com/Azure/aztk/master/account_setup.sh -O account_setup.sh &&
chmod 755 account_setup.sh &&
/bin/bash account_setup.sh
```

4. Follow the on screen prompts to create the necessary Azure resources and copy the output into your `.aztk/secrets.yaml` file. For more infomration see [Getting Started Scripts](./01-Getting-Started-Script).

This package is built on top of two core Azure services, [Azure Batch](https://azure.microsoft.com/en-us/services/batch/) and [Azure Storage](https://azure.microsoft.com/en-us/services/storage/). Create those resources via the portal (see [Getting Started](./docs/00-getting-started.md)).

## Quickstart Guide

Expand All @@ -55,7 +51,7 @@ aztk spark cluster list
aztk spark cluster delete
```
```sh
# login and submit jobs to your cluster
# login and submit applications to your cluster
aztk spark cluster ssh
aztk spark cluster submit
```
Expand Down
Loading

0 comments on commit 7ef721f

Please sign in to comment.