Skip to content

determined-ai/determined-release-testing

This branch is 3 commits ahead of, 772 commits behind determined-ai/determined:main.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

f21210a · Apr 23, 2024
Apr 22, 2024
Nov 20, 2023
Apr 22, 2024
Apr 23, 2024
Feb 21, 2024
Apr 23, 2024
Apr 22, 2024
Apr 18, 2024
Apr 22, 2024
Apr 19, 2024
Apr 18, 2024
Apr 23, 2024
Apr 17, 2024
Jun 14, 2023
Mar 19, 2024
Jul 6, 2023
Apr 23, 2024
Apr 17, 2024
Apr 18, 2024
Apr 22, 2024
Apr 17, 2024
May 9, 2023
Dec 6, 2022
Aug 30, 2023
Jan 10, 2024
Mar 20, 2024
Apr 18, 2024
Jul 15, 2022
Jun 26, 2023
Dec 6, 2022
Apr 18, 2024
Nov 3, 2022
Dec 6, 2022
Mar 9, 2024
Apr 18, 2024
Apr 18, 2024
Jan 3, 2024
Apr 17, 2024
Feb 15, 2024
Dec 7, 2023
Apr 18, 2024
Apr 18, 2024
Dec 1, 2022
Apr 15, 2024

Determined AI Logo

Determined is an all-in-one deep learning platform, compatible with PyTorch and TensorFlow.

It takes care of:

  • Distributed training for faster results.
  • Hyperparameter tuning for obtaining the best models.
  • Resource management for cutting cloud GPU costs.
  • Experiment tracking for analysis and reproducibility.

Features gif

How Determined Works

The main components of Determined are the Python library, the command line interface (CLI), and the Web UI.

Python Library

Use the Python library to make your existing PyTorch or Tensorflow code compatible with Determined.

You can do this by organizing your code into one of the class-based APIs:

from determined.pytorch import PyTorchTrial

class YourExperiment(PyTorchTrial):
  def __init__(self, context):
    ...

Or by using just the functions you want, via the Core API:

import determined as det

with det.core.init() as core_context:
    ...

Command Line Interface (CLI)

You can use the CLI to:

  • Start a Determined cluster locally:
det deploy local cluster-up
  • Launch Determined on cloud services, such as Amazon Web Services (AWS) or Google Cloud Platform (GCP):
det deploy aws up
  • Train your models:
det experiment create gpt.yaml .

Configure everything from distributed training to hyperparameter tuning using YAML files:

resources:
  slots_per_trial: 8
  priority: 1
hyperparameters:
  learning_rate:
    type: double
    minval: .0001
    maxval: 1.0
searcher:
  name: adaptive_asha
  metric: validation_loss
  smaller_is_better: true

Web UI

Use the Web UI to view loss curves, hyperparameter plots, code and configuration snapshots, model registries, cluster utilization, debugging logs, performance profiling reports, and more.

Web UI

Installation

To install the CLI:

pip install determined

Then use det deploy to start the Determined cluster locally, or on cloud services like AWS and GCP.

For installation details, visit the the cluster deployment guide for your environment:

Examples

Get familiar with Determined by exploring the 30+ examples in the examples folder and the determined-examples repo.

Documentation

Community

If you need help, want to file a bug report, or just want to keep up-to-date with the latest news about Determined, please join the Determined community!

Contributing

Contributor's Guide

License

Apache V2

About

A forked copy of Determined meant for testing the release process

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Go 43.2%
  • Python 31.5%
  • TypeScript 22.1%
  • SCSS 0.9%
  • Shell 0.7%
  • PLpgSQL 0.4%
  • Other 1.2%