Code

Bugfixes from Fairseq integration#129

Code

Merged

odp merged 14 commits intopetuum:masterpetuum/adaptdl:masterfrom odp:fairseq-fixesodp/adaptdl:fairseq-fixesCopy head branch name to clipboardAug 2, 2022

+40-10

Commits

Commits on Feb 7, 2022

• 1. divide actual grads and not copy 2. adjust adamscale prev step

  odp

  committed
  90b8b89

  Copy full SHA for 90b8b89

Commits on Mar 2, 2022

• final fixes

  odp

  committed
  5caed51

  Copy full SHA for 5caed51

Commits on Mar 13, 2022

• use max_tokens for local_bsz

  odp

  committed
  bb24f60

  Copy full SHA for bb24f60

Commits on Apr 18, 2022

• Merge branch 'petuum:master' into fairseq-fixes

  odp

  authored
  c717e54

  Copy full SHA for c717e54

Commits on Apr 19, 2022

• Merge branch 'petuum:master' into fairseq-fixes

  odp

  authored
  2289092

  Copy full SHA for 2289092

Commits on Apr 23, 2022

• Merge branch 'petuum:master' into fairseq-fixes

  odp

  authored
  6f9abde

  Copy full SHA for 6f9abde

Commits on Jul 25, 2022

• Merge branch 'petuum:master' into fairseq-fixes

  odp

  authored
  5980ebc

  Copy full SHA for 5980ebc

Commits on Jul 27, 2022

• move pinv to the same device as the parameters

  odp

  committed
  7544a4b

  Copy full SHA for 7544a4b

Commits on Aug 2, 2022

• constrain atomic_bsz before goodput evaluation

  odp

  committed
  24785b1

  Copy full SHA for 24785b1

• remove hack around local_bsz

  odp

  committed
  86f92cc

  Copy full SHA for 86f92cc

• remove gns/lr scaling tweaks

  odp

  committed
  975de27

  Copy full SHA for 975de27

• lint

  odp

  committed
  9e3b415

  Copy full SHA for 9e3b415

• merge master

  odp

  committed
  b5595d3

  Copy full SHA for b5595d3

• Merge branch 'master' into fairseq-fixes

  odp

  authored
  8fe4a8f

  Copy full SHA for 8fe4a8f