Code

Inference Checkpoints#4620

Code

Merged

cmikeh2 merged 22 commits intocholmes/checkpoints-inference-v2-2microsoft/DeepSpeed:cholmes/checkpoints-inference-v2-2from cholmes/checkpoints-inference-v2microsoft/DeepSpeed:cholmes/checkpoints-inference-v2Copy head branch name to clipboardNov 10, 2023

+924-4,597

Commits

Commits on Nov 3, 2023

• DeepSpeed-FastGen (#622)

  Show description for 49cea1a
  

  6 peopleauthored
  49cea1a

  Copy full SHA for 49cea1a

• Merge branch 'master' into staging-inference-v2-5

  cmikeh2

  authored
  74b6f76

  Copy full SHA for 74b6f76

• Isolate src code and tests for faster CI

  cmikeh2

  committed
  61ad33d

  Copy full SHA for 61ad33d

• Local unit tests passing

  cmikeh2

  committed
  c1b1c2a

  Copy full SHA for c1b1c2a

• Merge branch 'master' into cholmes/isolate-src-code

  cmikeh2

  authored
  32b3cbd

  Copy full SHA for 32b3cbd

Commits on Nov 4, 2023

• Functional PoC

  cmikeh2

  committed
  5ee1dd6

  Copy full SHA for 5ee1dd6

Commits on Nov 7, 2023

• Merge branch 'master' into cholmes/checkpoints-inference-v2

  awan-10

  authored
  aff9b4c

  Copy full SHA for aff9b4c

• Merge branch 'master' into cholmes/checkpoints-inference-v2

  RezaYazdaniAminabadi

  authored
  0faea35

  Copy full SHA for 0faea35

Commits on Nov 9, 2023

• Typing cleanup, remove private access

  cmikeh2

  committed
  07a1c93

  Copy full SHA for 07a1c93

• fix a few things with writing and loading the new checkpoint

  

  Reza Yazdani

  committed
  75b0e89

  Copy full SHA for 75b0e89

• Merge branch 'cholmes/checkpoints-inference-v1' of github.com:microsoft/DeepSpeed into cholmes/checkpoints-inference-v2

  

  Reza Yazdani

  committed
  573c21b

  Copy full SHA for 573c21b

• Add documentation on local methods

  cmikeh2

  committed
  be3a27a

  Copy full SHA for be3a27a

• Scope out changes in unit tests from the CI

  cmikeh2

  committed
  04e6907

  Copy full SHA for 04e6907

• Fix failing unit tests, remove duplicates

  cmikeh2

  committed
  d3434b3

  Copy full SHA for d3434b3

• refactor build_hf_engine and expose a new engine-creation

  

  Reza Yazdani

  committed
  27ba203

  Copy full SHA for 27ba203

• small fix

  

  Reza Yazdani

  committed
  91385d2

  Copy full SHA for 91385d2

Commits on Nov 10, 2023

• Unit test implementation

  cmikeh2

  committed
  89566b4

  Copy full SHA for 89566b4

• Formatting

  cmikeh2

  committed
  295fa61

  Copy full SHA for 295fa61

• Remove debug code

  cmikeh2

  committed
  9b0bcca

  Copy full SHA for 9b0bcca

• Remove unused files

  cmikeh2

  committed
  c65aebc

  Copy full SHA for c65aebc

• Engine factor documentation

  cmikeh2

  committed
  ee87ca7

  Copy full SHA for ee87ca7

• Merge branch 'master' into cholmes/checkpoints-inference-v2

  cmikeh2

  authored
  b12d6be

  Copy full SHA for b12d6be