Skip to content

llmariner/job-manager

Folders and files

NameName
Last commit message
Last commit date

Latest commit

a22ff3d · Nov 25, 2024
Nov 25, 2024
Oct 29, 2024
Nov 25, 2024
Nov 25, 2024
Nov 25, 2024
Sep 30, 2024
May 1, 2024
Oct 11, 2024
Nov 15, 2024
Sep 30, 2024
Aug 28, 2024
Oct 23, 2024
Nov 1, 2024
Sep 30, 2024
Aug 28, 2024
Mar 30, 2024
Aug 28, 2024
Mar 30, 2024
Nov 8, 2024
Nov 17, 2024
Nov 17, 2024
Sep 30, 2024
Aug 28, 2024

Repository files navigation

job-manager

Job Manage manages fine-tuning jobs.

Running Dispatcher Locally

You can run dispatcher locally.

make build-dispatcher
./bin/dispatcher run --config config.yaml

config.yaml has the following content:

jobPollingInterval: 10s
job:
  image: llmariner/experiments-fake-job
  version: latest
  numGpus: 0

debug:
  kubeconfigPath: /Users/kenji/.kube/config
  standalone: true
  sqlitePath: /tmp/job_manager.db

You can then connect to the DB and create a job.

sqlite3 /tmp/job_manager.db
# Run the query inside the database.
insert into jobs
  (job_id, message, state, tenant_id, version, created_at, updated_at)
values
  ('my-job', '', 'queued', 'my-tenant', 0, time('now'), time('now'));