Code

Compile and Ctranslate2 support#161

Code

Merged

vince62s merged 19 commits intoeole-nlp:maineole-nlp/eole:mainfrom vince62s:compilevince62s/eole:compileCopy head branch name to clipboardDec 18, 2024

+255-187

Commits

Commits on Dec 12, 2024

• add compile + torch 2.5.1 changes

  vince62s

  committed
  5abed3b

  Copy full SHA for 5abed3b

• fix config

  vince62s

  committed
  cbc1c98

  Copy full SHA for cbc1c98

• torch 2.5.1

  vince62s

  committed
  219368c

  Copy full SHA for 219368c

• compile default False

  vince62s

  committed
  41ef121

  Copy full SHA for 41ef121

Commits on Dec 14, 2024

• small chnages to rope + rmsnorm / remove compile global at inference (not applicable)

  vince62s

  committed
  889b680

  Copy full SHA for 889b680

• Interleave false by default

  vince62s

  committed
  9654e86

  Copy full SHA for 9654e86

• remove complex ops

  vince62s

  committed
  8aa0f04

  Copy full SHA for 8aa0f04

Commits on Dec 17, 2024

• fix ct2 temporary inference

  vince62s

  committed
  43746f9

  Copy full SHA for 43746f9

• black

  vince62s

  committed
  d98c877

  Copy full SHA for d98c877

• fix tests

  vince62s

  committed
  4f4f4fb

  Copy full SHA for 4f4f4fb

• typo

  vince62s

  committed
  bed1343

  Copy full SHA for bed1343

• fix test again

  vince62s

  committed
  d6624de

  Copy full SHA for d6624de

• damned

  vince62s

  committed
  10e3e26

  Copy full SHA for 10e3e26

• fix name mismatch

  vince62s

  committed
  b710259

  Copy full SHA for b710259

• tests

  vince62s

  committed
  72e2505

  Copy full SHA for 72e2505

• missing files

  vince62s

  committed
  4204234

  Copy full SHA for 4204234

Commits on Dec 18, 2024

• move output file writing to align with ct2 logic

  vince62s

  committed
  e357b72

  Copy full SHA for e357b72

• fix nbest > 1

  vince62s

  committed
  298e289

  Copy full SHA for 298e289

• readme torch version

  vince62s

  committed
  3464d09

  Copy full SHA for 3464d09