Code

Use tiktoken#1044

Code

Merged

jongwook merged 9 commits intomainopenai/whisper:mainfrom use-tiktokenopenai/whisper:use-tiktokenCopy head branch name to clipboardMar 13, 2023

+100,601-100,096

Commits

Commits on Mar 7, 2023

• use tiktoken==0.3.0

  jongwook

  committed
  5e35893

  Copy full SHA for 5e35893

• formatting

  jongwook

  committed
  39237a3

  Copy full SHA for 39237a3

• tuple should be safer

  jongwook

  committed
  67e8805

  Copy full SHA for 67e8805

Commits on Mar 13, 2023

• Update whisper/tokenizer.py

  Show description for 117ed3e
  

  jongwook

  and

  Majdoddin

  authored
  117ed3e

  Copy full SHA for 117ed3e

• Merge branch 'main' into use-tiktoken

  jongwook

  authored
  06e59be

  Copy full SHA for 06e59be

• use tiktoken 0.3.1

  jongwook

  committed
  2a14e80

  Copy full SHA for 2a14e80

• reflecting suggestions

  jongwook

  committed
  6869cd8

  Copy full SHA for 6869cd8

• cleanup

  jongwook

  committed
  72e5e67

  Copy full SHA for 72e5e67

• bypassing load_tiktoken_bpe to avoid blobfile dep

  jongwook

  committed
  a0bd014

  Copy full SHA for a0bd014