Code

llama : add grammar-based sampling#1773

Code

Merged

ejones merged 22 commits intoggerganov:masterggerganov/llama.cpp:masterfrom ejones:grammarejones/llama.cpp:grammarCopy head branch name to clipboardJul 24, 2023

+977-1

Commits

Commits on Jun 9, 2023

• llama, main : constrain sampling to grammar

  ejones

  committed
  fd0eb66

  Copy full SHA for fd0eb66

Commits on Jun 12, 2023

• allow loading grammar from file

  ejones

  committed
  834d423

  Copy full SHA for 834d423

• fix whitespace errors

  ejones

  committed
  9e77f42

  Copy full SHA for 9e77f42

• handle & print parser errors

  ejones

  committed
  674bb08

  Copy full SHA for 674bb08

• add comments to grammar syntax and allow newlines where unambiguous

  ejones

  committed
  98a9587

  Copy full SHA for 98a9587

• Merge remote-tracking branch 'refs/remotes/upstream/master' into grammar

  ejones

  committed
  56904ca

  Copy full SHA for 56904ca

• add missing include

  ejones

  committed
  3e78f00

  Copy full SHA for 3e78f00

Commits on Jun 15, 2023

• support alternates in root rule

  ejones

  committed
  421c6e1

  Copy full SHA for 421c6e1

• fix bugs with empty token and EOS

  ejones

  committed
  b876d19

  Copy full SHA for b876d19

• adjust JSON grammar

  ejones

  committed
  58ca9bc

  Copy full SHA for 58ca9bc

• remove swp file

  ejones

  committed
  414f251

  Copy full SHA for 414f251

Commits on Jun 18, 2023

• rewrite ternary expressions

  Show description for 18e6221
  

  ejones

  and

  SlyEcho

  authored
  18e6221

  Copy full SHA for 18e6221

Commits on Jun 29, 2023

• use struct for grammar elements and add Unicode support

  ejones

  committed
  f8baad2

  Copy full SHA for f8baad2

Commits on Jul 6, 2023

• Merge remote-tracking branch 'upstream/master' into grammar

  ejones

  committed
  38fbd40

  Copy full SHA for 38fbd40

Commits on Jul 11, 2023

• add unicode escapes

  ejones

  committed
  014fbfd

  Copy full SHA for 014fbfd

Commits on Jul 12, 2023

• Merge remote-tracking branch 'upstream/master' into grammar

  ejones

  committed
  b2e071d

  Copy full SHA for b2e071d

Commits on Jul 19, 2023

• add inverse char ranges

  ejones

  committed
  8d37755

  Copy full SHA for 8d37755

Commits on Jul 21, 2023

• only sample full tokens (no peeking or truncation)

  ejones

  committed
  c047e8a

  Copy full SHA for c047e8a

• llama : minor style changes

  Show description for 11315b1
  ggerganov

  authored
  11315b1

  Copy full SHA for 11315b1

Commits on Jul 24, 2023

• Merge remote-tracking branch 'upstream/master' into grammar

  ejones

  committed
  8145bca

  Copy full SHA for 8145bca

• update help text

  ejones

  committed
  f7f1d26

  Copy full SHA for f7f1d26

• add warning message if EOS is disabled

  ejones

  committed
  4cd9711

  Copy full SHA for 4cd9711