Code

Bloom att mask#1

Code

Merged

Muennighoff merged 4 commits intoMuennighoff:prefixlmMuennighoff/transformers:prefixlmfrom NouamaneTazi:bloom-att-maskNouamaneTazi/transformers:bloom-att-maskCopy head branch name to clipboardJul 20, 2022

+5-4

Commits

Commits on Jul 18, 2022

• fix causal_mask

  Show description for 6870de6
  NouamaneTazi

  committed
  6870de6

  Copy full SHA for 6870de6

• fix softmax for float16

  Show description for 69e72e1
  

  NouamaneTazi

  and

  younesbelkada

  committed
  69e72e1

  Copy full SHA for 69e72e1

• styling

  NouamaneTazi

  committed
  6815664

  Copy full SHA for 6815664

• revert back to using addition for some speed

  Show description for 93eaaff
  NouamaneTazi

  committed
  93eaaff

  Copy full SHA for 93eaaff